-- Logs begin at Mon 2021-11-08 03:20:16 UTC, end at Mon 2021-11-08 04:59:00 UTC. -- Nov 08 04:02:25.037015 dv-cinder-783643-4-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 08 04:02:27.746786 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.common.config [-] Logging enabled! Nov 08 04:02:27.747371 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev147 Nov 08 04:02:27.747572 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=101555) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 08 04:02:27.750774 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.common.config [-] Logging enabled! Nov 08 04:02:27.751032 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev147 Nov 08 04:02:27.751345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=101555) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 08 04:02:27.752275 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 04:02:27.752508 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 04:02:27.752877 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 04:02:27.753121 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 04:02:27.753358 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 04:02:27.753658 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.754077 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 08 04:02:27.754386 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.754705 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.754997 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.755546 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.755833 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.756111 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.756399 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.756695 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.756981 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.757259 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.757544 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.757833 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.758115 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] config_source = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.758405 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.758724 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.759012 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] debug = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.759294 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.759723 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.760138 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.760445 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.760736 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.761014 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.761285 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.761560 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.761843 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.762168 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] host = dv-cinder-783643-4-iscsi {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.762445 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.762757 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.763043 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.763329 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.763606 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.763886 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.764166 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.764436 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] log_dir = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.764709 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] log_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.764982 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.765274 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.765560 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.765847 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.766070 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.766290 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.766615 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.766907 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.767181 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.767455 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.767728 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.768000 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.768272 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.768542 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.768827 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.769115 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.769400 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.769675 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.769947 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.770220 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.770500 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.770801 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.771074 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.771346 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.771618 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.771903 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.772170 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.772441 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.772740 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.773025 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.773306 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.773590 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.773860 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.774142 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.774410 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.774710 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] use_journal = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.774979 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] use_json = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.775249 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.775517 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.775795 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.776097 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.776365 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.776667 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.776940 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.777226 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:27.777523 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.777819 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.778112 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.778392 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.778726 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.779014 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.779303 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.779580 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.779866 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.780152 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.780440 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.780720 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.781006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.781281 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.781575 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.781876 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.782173 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.782467 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.782775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.783051 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.783324 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.783603 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.783893 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.784175 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.784464 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.784757 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.785037 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.785324 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.785619 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.785909 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.786184 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.786465 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.786781 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.787060 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.787334 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.787612 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.787899 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.788176 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.788448 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.788732 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.789013 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.789284 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.789554 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.789831 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.790121 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.790396 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.790691 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.790962 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.791237 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.791508 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.792317 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.792590 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.792863 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.793135 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.793411 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.793683 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.793954 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.794233 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.794527 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.794807 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.795081 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.795352 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.795622 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.795893 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.796164 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.796433 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.796702 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.796979 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.797249 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.797520 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.797791 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.798062 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.798337 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.798652 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.798953 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.799235 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.799520 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.799798 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.800076 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.800354 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.800629 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.800907 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.801189 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.801459 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.801750 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.802033 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.802317 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.802629 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.802907 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.803219 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.803498 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.803779 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.804055 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.804329 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.804611 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.804892 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.805188 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.805482 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.805775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.806066 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.806359 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.806669 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.806982 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.807325 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:27.808032 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 04:02:27.808274 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=101555) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 08 04:02:28.241541 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=101555) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 04:02:28.241815 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=101555) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 04:02:28.242114 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=101555) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 04:02:28.242447 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 08 04:02:28.561345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.561659 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.561934 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.563146 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.563431 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.563698 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.599032 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.599316 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.599585 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.614659 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.614943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.615215 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.645464 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.645745 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.646016 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.681882 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.682186 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.682458 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.917977 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.918613 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.918613 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.918872 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:28.919409 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.046266 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.046611 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.046902 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.047178 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.047448 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.047760 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.048023 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.048283 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.048540 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.048824 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.049085 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.049352 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.049612 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.049866 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.050124 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.050390 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.050671 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.050939 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.051207 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.051466 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.051734 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.051991 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.052272 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.052655 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.052907 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.053155 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.053558 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=101555) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 04:02:29.053802 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=101555) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 04:02:29.054040 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=101555) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 04:02:29.054278 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=101555) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 04:02:29.054536 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=101555) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 04:02:29.054775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=101555) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 04:02:29.055138 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 08 04:02:29.058892 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 08 04:02:29.062876 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 08 04:02:29.066684 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(150, 199)])]) Nov 08 04:02:29.068320 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 08 04:02:29.068784 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 08 04:02:29.069120 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 08 04:02:29.069508 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 08 04:02:29.072337 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 08 04:02:29.072587 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 08 04:02:29.073535 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 08 04:02:29.078878 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 08 04:02:29.100996 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 08 04:02:29.101452 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.101756 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=101555) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Nov 08 04:02:29.102120 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.103545 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=101555) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 08 04:02:29.103827 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 08 04:02:29.104096 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 08 04:02:29.107320 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.107606 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:29.171868 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 08 04:02:29.172050 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 08 04:02:29.172286 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 08 04:02:29.172649 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 08 04:02:29.193404 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_db.sqlalchemy.engines [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101555) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 04:02:29.826892 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Initializing driver for type 'gre' Nov 08 04:02:29.827413 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] gre ID ranges: [(1, 1000)] Nov 08 04:02:30.026900 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Initializing driver for type 'local' Nov 08 04:02:30.027488 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Initializing driver for type 'vlan' Nov 08 04:02:30.140969 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] VlanTypeDriver initialization complete Nov 08 04:02:30.141313 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Initializing driver for type 'vxlan' Nov 08 04:02:30.141829 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] vxlan ID ranges: [(1, 1000)] Nov 08 04:02:30.335573 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Initializing extension driver 'port_security' Nov 08 04:02:30.335918 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.extensions.port_security [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] PortSecurityExtensionDriver initialization complete Nov 08 04:02:30.336251 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Initializing mechanism driver 'openvswitch' Nov 08 04:02:30.336578 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Initializing mechanism driver 'hyperv' Nov 08 04:02:30.346555 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.plugins.ml2.plugin [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=101555) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:02:30.347413 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > port after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.347816 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > port after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.348175 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > port after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.348704 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=101555) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 04:02:30.349137 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > subnet after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.349495 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > subnet after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.349853 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > subnet after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.350247 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=101555) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 04:02:30.350680 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > network after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.351032 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > network after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.351422 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > network after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.351819 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=101555) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 04:02:30.352218 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > security_group after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.352568 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > security_group after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.352913 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > security_group after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.353303 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=101555) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 04:02:30.353705 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.354088 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.354434 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.354887 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=101555) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 04:02:30.355280 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > address_group after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.355631 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > address_group after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.355975 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > address_group after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.356369 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=101555) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 08 04:02:30.356744 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] ML2 OVO RPC backend initialized. {{(pid=101555) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 08 04:02:30.357451 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router_interface after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.357810 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router_interface after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.358231 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > network before_response 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.358610 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > networks before_response 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.358963 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > port before_response 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.359311 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > ports before_response 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.359656 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > subnet before_response 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.360008 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > subnets before_response 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.360360 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > network after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.360704 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > network after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.361043 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > network after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.361383 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > port after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.361720 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > port after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.362054 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > port after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.362394 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > subnet after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.362757 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > subnet after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.363120 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > subnet after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.363695 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.plugin [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Modular L2 Plugin initialization complete Nov 08 04:02:30.364023 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading services supported by the core plugin {{(pid=101555) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 08 04:02:30.364352 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.plugins.ml2.managers [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Got port-security extension from driver 'port_security' Nov 08 04:02:30.364816 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.extensions.vlantransparent [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Disabled vlantransparent extension. Nov 08 04:02:30.365306 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=101555) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 08 04:02:30.365620 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading Plugin: router Nov 08 04:02:30.408855 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router_interface before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.409252 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router after_create 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.409626 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router before_create 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.409994 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router_interface before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.410369 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router_interface after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.410768 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router after_delete 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.411136 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > floatingip after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.411611 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > floatingip after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.411976 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router after_create 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.412328 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router after_update 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.412680 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router after_update 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.413030 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.413393 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router after_update 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.413805 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router precommit_update 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.414174 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: port after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.414608 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: port after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.414954 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: subnet after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.415296 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.415652 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > port precommit_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.416002 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router precommit_create 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.416347 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: port before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.416719 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router precommit_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.417081 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router after_update 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.417423 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router precommit_delete 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.417777 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router precommit_create 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.418144 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router_interface after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.418507 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router precommit_update 55549900 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.418891 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > agent after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.419246 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > agent after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.419593 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > network after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.420467 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Tracking information for resource: router configured {{(pid=101555) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 04:02:30.420806 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Tracking information for resource: floatingip configured {{(pid=101555) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 08 04:02:30.427535 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.db.l3_agentschedulers_db [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 08 04:02:30.428109 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: port after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.428474 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: port after_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.428829 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: port after_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.429184 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: port after_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.429985 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router before_create 55550100 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.430354 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router precommit_delete 55550100 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.430751 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router precommit_create 55550100 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.431112 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > router precommit_update 55550100 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.436565 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.services.provider_configuration [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service providers = [] {{(pid=101555) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 08 04:02:30.436931 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.db.servicetype_db [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=101555) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 08 04:02:30.439937 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.services.service_base [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=101555) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 08 04:02:30.440294 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.services.service_base [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=101555) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 08 04:02:30.440641 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.services.service_base [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=101555) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 08 04:02:30.441531 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.services.service_base [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=101555) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 08 04:02:30.441908 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.services.service_base [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 08 04:02:30.442295 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=101555) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 04:02:30.442645 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 08 04:02:30.460441 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Successfully loaded METERING plugin. Description: METERING {{(pid=101555) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 04:02:30.460776 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading Plugin: auto_allocate Nov 08 04:02:30.466669 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: network precommit_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.467047 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: network precommit_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.467571 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=101555) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 04:02:30.467895 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading Plugin: tag Nov 08 04:02:30.474718 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=101555) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 04:02:30.475051 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading Plugin: timestamp Nov 08 04:02:30.478915 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=101555) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 04:02:30.479270 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading Plugin: network_ip_availability Nov 08 04:02:30.484753 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.485128 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.485488 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.486204 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=101555) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 04:02:30.486560 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading Plugin: flavors Nov 08 04:02:30.499041 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=101555) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 04:02:30.499377 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading Plugin: revisions Nov 08 04:02:30.503691 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=101555) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 08 04:02:30.504125 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_concurrency.lockutils [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 2.262s {{(pid=101555) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 04:02:30.504870 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=101555) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 08 04:02:30.505474 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Initializing extension manager. Nov 08 04:02:30.506017 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: __init__.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.506363 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: __pycache__ {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.506731 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.507070 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: address_group.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.507835 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.508405 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: address-group Nov 08 04:02:30.508732 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: address_scope.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.509450 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.509968 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: address-scope Nov 08 04:02:30.510445 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: admin_state_down_before_update.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.511874 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.512395 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: router-admin-state-down-before-update Nov 08 04:02:30.512726 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: agent.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.513444 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.513950 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: agent Nov 08 04:02:30.514275 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: agent_resources_synced.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.515221 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.515743 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: agent-resources-synced Nov 08 04:02:30.516067 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: allowedaddresspairs.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.517905 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.518423 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: allowed-address-pairs Nov 08 04:02:30.518778 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: auto_allocated_topology.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.519871 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.520395 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: auto-allocated-topology Nov 08 04:02:30.520728 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: availability_zone.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.521427 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.521936 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: availability_zone Nov 08 04:02:30.522263 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: availability_zone_filter.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.534409 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.534958 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: availability_zone_filter Nov 08 04:02:30.535288 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: data_plane_status.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.536208 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.536717 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension data-plane-status not supported by any of loaded plugins Nov 08 04:02:30.537045 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: default_subnetpools.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.537967 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.538476 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: default-subnetpools Nov 08 04:02:30.538829 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: dhcpagentscheduler.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.539651 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.540180 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: dhcp_agent_scheduler Nov 08 04:02:30.540506 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: dns.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.541453 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.541958 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension dns-integration not supported by any of loaded plugins Nov 08 04:02:30.542284 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: dns_domain_ports.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.543339 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.543848 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 08 04:02:30.544172 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.545105 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.545612 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 08 04:02:30.545938 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: dvr.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.546642 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.547144 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: dvr Nov 08 04:02:30.547467 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: ecmp_routes.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.548393 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.548895 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension ecmp_routes not supported by any of loaded plugins Nov 08 04:02:30.549223 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: empty_string_filtering.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.550153 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.550685 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: empty-string-filtering Nov 08 04:02:30.551013 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.551990 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.552497 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 08 04:02:30.552823 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.553757 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.554271 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 08 04:02:30.554632 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: external_net.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.555550 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.556061 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: external-net Nov 08 04:02:30.556387 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: extra_dhcp_opt.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.563169 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.563675 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: extra_dhcp_opt Nov 08 04:02:30.564003 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: extraroute.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.564924 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.565431 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: extraroute Nov 08 04:02:30.565757 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: extraroute_atomic.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.566842 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.567358 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: extraroute-atomic Nov 08 04:02:30.567685 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: filter_validation.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.568575 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.569087 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: filter-validation Nov 08 04:02:30.569415 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: fip_pf_description.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.570344 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.570891 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 08 04:02:30.571220 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: fip_port_details.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.572153 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.572660 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: fip-port-details Nov 08 04:02:30.573529 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: flavors.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.574862 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.575382 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: flavors Nov 08 04:02:30.575712 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.577391 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.577912 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 08 04:02:30.578247 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: floatingip_pools.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.578999 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.579507 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: floatingip-pools Nov 08 04:02:30.579835 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: ip_allocation.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.580826 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.581318 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension ip_allocation not supported by any of loaded plugins Nov 08 04:02:30.581649 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: ip_substring_port_filtering.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.582612 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.583127 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: ip-substring-filtering Nov 08 04:02:30.583475 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: l2_adjacency.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.584387 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.584900 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension l2_adjacency not supported by any of loaded plugins Nov 08 04:02:30.585226 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: l3.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.586250 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.586747 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: router Nov 08 04:02:30.587074 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: l3_conntrack_helper.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.589380 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.589909 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 08 04:02:30.590243 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: l3_ext_gw_mode.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.591225 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.591756 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: ext-gw-mode Nov 08 04:02:30.592085 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: l3_ext_ha_mode.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.593025 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.593542 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: l3-ha Nov 08 04:02:30.593869 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: l3_flavors.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.594814 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.595324 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: l3-flavors Nov 08 04:02:30.595648 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.596565 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.597083 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: l3-port-ip-change-not-allowed Nov 08 04:02:30.597408 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: l3agentscheduler.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.598449 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.598988 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: l3_agent_scheduler Nov 08 04:02:30.599320 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: logging.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.600837 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.601364 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension logging not supported by any of loaded plugins Nov 08 04:02:30.601700 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: metering.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.602456 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.603059 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: metering Nov 08 04:02:30.603392 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.604641 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.608481 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: metering_source_and_destination_fields Nov 08 04:02:30.608481 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: multiprovidernet.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.609214 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.609738 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: multi-provider Nov 08 04:02:30.610070 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: netmtu.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.611024 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.611536 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: net-mtu Nov 08 04:02:30.611867 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: netmtu_writable.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.612805 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.613313 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: net-mtu-writable Nov 08 04:02:30.613644 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: network_availability_zone.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.614327 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.614892 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: network_availability_zone Nov 08 04:02:30.615221 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: network_ip_availability.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.616338 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.616849 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: network-ip-availability Nov 08 04:02:30.617178 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: network_segment_range.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.617945 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.618454 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension network-segment-range not supported by any of loaded plugins Nov 08 04:02:30.618804 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: pagination.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.620432 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.620767 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: pagination Nov 08 04:02:30.621092 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: port_device_profile.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.622018 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.622572 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: port-device-profile Nov 08 04:02:30.622903 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: port_mac_address_regenerate.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.623831 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.627418 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: port-mac-address-regenerate Nov 08 04:02:30.627812 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: port_numa_affinity_policy.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.628758 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.629282 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: port-numa-affinity-policy Nov 08 04:02:30.629612 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: port_resource_request.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.637693 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.638206 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension port-resource-request not supported by any of loaded plugins Nov 08 04:02:30.638572 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: port_resource_request_groups.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.639561 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.640073 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 08 04:02:30.640420 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: portbindings.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.641342 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.641852 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: binding Nov 08 04:02:30.642180 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: portbindings_extended.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.643528 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.644046 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: binding-extended Nov 08 04:02:30.644376 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: portsecurity.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.645296 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.645808 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: port-security Nov 08 04:02:30.646132 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: project_id.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.647150 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.647486 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: project-id Nov 08 04:02:30.647815 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: providernet.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.648748 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.649264 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: provider Nov 08 04:02:30.649595 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.653301 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.653828 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos not supported by any of loaded plugins Nov 08 04:02:30.654236 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos_bw_limit_direction.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.655508 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.656022 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 08 04:02:30.656354 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.657281 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.657792 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 08 04:02:30.658121 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos_default.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.659078 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.666122 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos-default not supported by any of loaded plugins Nov 08 04:02:30.666122 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos_fip.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.666122 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.666122 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos-fip not supported by any of loaded plugins Nov 08 04:02:30.666122 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos_gateway_ip.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.667403 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.667916 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 08 04:02:30.668243 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos_port_network_policy.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.669169 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.669675 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 08 04:02:30.670001 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.671086 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.671626 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 08 04:02:30.671954 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos_pps_rule.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.673158 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.673851 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos-pps not supported by any of loaded plugins Nov 08 04:02:30.674188 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos_rule_type_details.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.675156 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.675677 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 08 04:02:30.676007 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: qos_rules_alias.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.677051 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.677564 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 08 04:02:30.677894 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: quota_check_limit.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.678855 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.679369 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: quota-check-limit Nov 08 04:02:30.679700 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: quotasv2.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.680639 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.680973 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: quotas Nov 08 04:02:30.681299 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: quotasv2_detail.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.685063 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.685406 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: quota_details Nov 08 04:02:30.685743 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: rbac.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.686852 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.687386 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: rbac-policies Nov 08 04:02:30.687721 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: rbac_address_group.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.688770 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.689198 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: rbac-address-group Nov 08 04:02:30.689529 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: rbac_address_scope.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.695737 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.696271 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: rbac-address-scope Nov 08 04:02:30.696603 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: rbac_security_groups.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.697551 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.698101 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: rbac-security-groups Nov 08 04:02:30.698428 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: rbac_subnetpool.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.699394 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.699902 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: rbac-subnetpool Nov 08 04:02:30.700269 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: revisionifmatch.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.701218 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.701727 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: revision-if-match Nov 08 04:02:30.702051 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: revisions.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.703225 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.703747 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: standard-attr-revisions Nov 08 04:02:30.704079 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: router_availability_zone.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.705844 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.705844 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: router_availability_zone Nov 08 04:02:30.705844 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: routerservicetype.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.706743 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.707264 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension router-service-type not supported by any of loaded plugins Nov 08 04:02:30.707593 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.708536 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.709058 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: security-groups-normalized-cidr Nov 08 04:02:30.709386 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: security_groups_port_filtering.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.710398 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.710944 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: port-security-groups-filtering Nov 08 04:02:30.715315 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: security_groups_remote_address_group.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.716060 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.716579 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: security-groups-remote-address-group Nov 08 04:02:30.716905 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: security_groups_shared_filtering.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.717849 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.718363 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: security-groups-shared-filtering Nov 08 04:02:30.718714 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.719316 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 08 04:02:30.719637 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: securitygroup.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.730326 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.730879 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: security-group Nov 08 04:02:30.731214 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: segment.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.732219 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.732757 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension segment not supported by any of loaded plugins Nov 08 04:02:30.732859 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.740931 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.741443 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 08 04:02:30.741773 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: servicetype.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.742934 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.743455 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: service-type Nov 08 04:02:30.743784 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: sorting.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.745410 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.745749 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: sorting Nov 08 04:02:30.746093 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: standard_attr_segment.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.747052 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.747568 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 08 04:02:30.747894 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: standardattrdescription.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.748548 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.749057 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: standard-attr-description Nov 08 04:02:30.749382 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: stateful_security_group.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.750329 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.750873 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: stateful-security-group Nov 08 04:02:30.751202 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: stdattrs_common.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.751777 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 08 04:02:30.752110 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.753037 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.753550 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 08 04:02:30.753874 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: subnet_onboard.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.754992 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.755764 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: subnet_onboard Nov 08 04:02:30.756094 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: subnet_segmentid_writable.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.757047 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.757561 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 08 04:02:30.757890 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: subnet_service_types.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.758862 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.759377 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: subnet-service-types Nov 08 04:02:30.759746 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: subnetallocation.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.760886 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.761399 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: subnet_allocation Nov 08 04:02:30.761727 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.762451 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.763014 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: subnetpool-prefix-ops Nov 08 04:02:30.763333 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.764271 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.764778 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 08 04:02:30.765102 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: tagging.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.766182 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.766717 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: standard-attr-tag Nov 08 04:02:30.767053 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: timestamp.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.768267 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.768792 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loaded extension: standard-attr-timestamp Nov 08 04:02:30.769125 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: trunk.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.770182 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.770726 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension trunk not supported by any of loaded plugins Nov 08 04:02:30.775024 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: trunk_details.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.775691 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.776238 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension trunk-details not supported by any of loaded plugins Nov 08 04:02:30.776569 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: uplink_status_propagation.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.777505 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.778019 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 08 04:02:30.778349 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Loading extension file: vlantransparent.py {{(pid=101555) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 08 04:02:30.779063 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=101555) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 08 04:02:30.779570 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extension vlan-transparent not supported by any of loaded plugins Nov 08 04:02:30.782101 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:network Nov 08 04:02:30.782673 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:subnet Nov 08 04:02:30.783077 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:subnetpool Nov 08 04:02:30.783480 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:port Nov 08 04:02:30.784725 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.785234 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service FLAVORS assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.785856 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.786294 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.786654 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:router Nov 08 04:02:30.787088 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:floatingip Nov 08 04:02:30.787562 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service METERING assigned prefix: /metering {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.789014 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.789396 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.789754 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101555) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:02:30.790786 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of CountableResource for resource:rbac_policy Nov 08 04:02:30.791260 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:security_group Nov 08 04:02:30.792224 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:security_group_rule Nov 08 04:02:30.792836 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service CORE assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.793169 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:subnetpool Nov 08 04:02:30.793520 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] subnetpool is already registered Nov 08 04:02:30.793940 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service CORE assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.794271 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:subnetpool Nov 08 04:02:30.794635 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] subnetpool is already registered Nov 08 04:02:30.797019 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.797487 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service FLAVORS assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.802576 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.802576 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.802576 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:router Nov 08 04:02:30.802576 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] router is already registered Nov 08 04:02:30.802576 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:floatingip Nov 08 04:02:30.802576 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] floatingip is already registered Nov 08 04:02:30.802576 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service METERING assigned prefix: /metering {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.802576 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of CountableResource for resource:rbac_policy Nov 08 04:02:30.803448 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] rbac_policy is already registered Nov 08 04:02:30.803448 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:security_group Nov 08 04:02:30.803448 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] security_group is already registered Nov 08 04:02:30.803448 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:security_group_rule Nov 08 04:02:30.803448 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] security_group_rule is already registered Nov 08 04:02:30.803448 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service CORE assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.803906 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:subnetpool Nov 08 04:02:30.803983 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] subnetpool is already registered Nov 08 04:02:30.804394 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.v2.resource_helper [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Service CORE assigned prefix: {{(pid=101555) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 08 04:02:30.804716 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Creating instance of TrackedResource for resource:subnetpool Nov 08 04:02:30.805046 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING neutron.quota.resource_registry [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] subnetpool is already registered Nov 08 04:02:30.806793 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: extensions {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.808885 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: address-groups {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.810373 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: address-scopes {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.811610 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: agents {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.812864 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: auto-allocated-topology {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.814174 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: availability_zones {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.815433 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: dhcp-networks {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.816823 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: dhcp-agents {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.818345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: routers {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.820531 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: flavors {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.821800 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: service_profiles {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.823081 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: next_providers {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.824594 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: service_profiles {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.826039 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: floatingip-pools {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.827386 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: routers {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.829497 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: floatingips {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.830942 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: l3-routers {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.832389 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: l3-agents {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.833792 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: metering-labels {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.835086 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: metering-label-rules {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.836522 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: network-ip-availabilities {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.837796 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: bindings {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.839428 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: quotas {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.841076 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: quotas {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.842694 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: rbac-policies {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.843887 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: security-groups {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.845233 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: security-group-rules {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.846518 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: service-providers {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.847702 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: subnetpools {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.849102 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: subnetpools {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.850669 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: tags {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.852335 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: tags {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.854731 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: tags {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.856505 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: tags {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.858202 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: tags {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.860239 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: tags {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.861923 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: tags {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.864795 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: tags {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.866650 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: tags {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.868381 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron.api.extensions [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Extended resource: tags {{(pid=101555) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 08 04:02:30.875273 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING keystonemiddleware.auth_token [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 04:02:30.879816 dv-cinder-783643-4-iscsi neutron-server[101555]: WARNING keystonemiddleware.auth_token [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 04:02:30.889013 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_concurrency.lockutils [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Acquired lock "singleton_lock" {{(pid=101555) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 08 04:02:30.889489 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_concurrency.lockutils [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Releasing lock "singleton_lock" {{(pid=101555) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 08 04:02:30.890135 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO oslo_service.service [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Starting 2 workers Nov 08 04:02:30.894963 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Started child 101664 {{(pid=101555) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 08 04:02:30.899393 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Started child 101665 {{(pid=101555) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 08 04:02:30.900490 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:30.901229 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO neutron.service [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Neutron service started, listening on 0.0.0.0:9696 Nov 08 04:02:30.901672 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Publish callbacks [] for process, before_spawn {{(pid=101555) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:30.902049 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [-] (101664) wsgi starting up on http://0.0.0.0:9696 Nov 08 04:02:30.904119 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO oslo_service.service [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Starting 1 workers Nov 08 04:02:30.904600 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:30.905968 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [-] (101665) wsgi starting up on http://0.0.0.0:9696 Nov 08 04:02:30.909347 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Started child 101666 {{(pid=101555) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 08 04:02:30.909881 dv-cinder-783643-4-iscsi neutron-server[101555]: INFO oslo_service.service [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Starting 1 workers Nov 08 04:02:30.913238 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.service [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] calling RpcWorker wait() {{(pid=101666) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 08 04:02:30.913773 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.service [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] returning from RpcWorker wait() {{(pid=101666) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 08 04:02:30.914386 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Started child 101667 {{(pid=101555) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 08 04:02:30.915109 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:30.915204 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG neutron_lib.callbacks.manager [None req-47b6ce9c-7988-4513-aeff-cc90e97bb83b None None] Publish callbacks [] for process, after_spawn {{(pid=101555) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:30.915638 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:02:30.917670 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=101555) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 08 04:02:30.917881 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 04:02:30.918068 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 04:02:30.918282 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 04:02:30.918625 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 04:02:30.918791 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 04:02:30.919302 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.919593 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.919860 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.920118 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.920396 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.920846 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:30.921342 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.921342 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.921511 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.921670 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.921928 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.922097 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.922263 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.922521 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.922776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.923069 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.923322 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.923585 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.923842 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.924014 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.924253 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] config_source = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.924510 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.924752 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.925015 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] debug = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.925279 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.925763 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.925995 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.926232 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.926453 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.926834 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.927064 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.927336 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.927572 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.927793 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.928039 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.928290 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.928530 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.928737 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.928971 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.929297 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.929447 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.929682 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.930155 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] host = dv-cinder-783643-4-iscsi {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.930387 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.930625 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.930867 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.931108 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.931358 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.935969 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.935969 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.935969 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.935969 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.935969 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.935969 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.935969 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.935969 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_dir = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.936541 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.936541 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_options = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.936541 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.936541 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.936541 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.936541 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.936541 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937037 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937037 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937037 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937037 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937037 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937037 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937037 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937037 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937620 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937620 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937620 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.937918 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.938094 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.938339 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.938589 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.938820 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.939063 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.939287 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.939522 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.939769 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.940048 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.940275 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.940482 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.940718 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.940971 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.941203 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.941449 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.941691 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.941926 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.942183 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.942424 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.942692 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.942906 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.943184 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.943406 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.943649 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.943910 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.944124 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.944365 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.944593 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.944832 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_journal = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.945066 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_json = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.945275 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.945503 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.945744 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.945969 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.946177 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.946384 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.946615 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.946859 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:30.947291 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.947540 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.947937 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.948196 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.948423 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.948660 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.948887 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.949103 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.949358 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.949677 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.950683 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.950811 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.951609 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.951609 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.951609 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.952488 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.952488 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.952488 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.952740 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.952935 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.953172 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.953425 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.953686 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.953904 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.954156 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.954386 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.954631 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.954959 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.955221 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.955488 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.21/identity {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.955758 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.955995 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.956210 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.956441 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.956653 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.956940 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.957640 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.957918 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.958016 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:02:30.958136 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.958347 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.958587 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.958817 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.959048 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962096 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962096 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962096 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962096 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962096 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962096 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962096 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962096 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962096 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962799 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962799 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962799 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962799 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962799 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962799 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.962799 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.963275 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.963275 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.963275 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.963554 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.963768 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.963983 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.964195 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.964445 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.964658 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.964867 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.965101 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.965331 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.965539 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.965763 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.966009 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.966216 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.966430 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.966669 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.966898 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.967126 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.967335 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.967542 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.967766 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.967991 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.968278 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.969063 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.969294 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.969674 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.969904 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.970276 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.970756 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.971064 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.971313 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.971568 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.971806 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.972057 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.972272 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.972513 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.972733 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.972950 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.973177 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.973419 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.973832 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.974075 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.974467 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.974861 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.975120 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.975341 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.975579 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.975820 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.976077 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.976297 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.976569 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.976801 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.977038 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.977286 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.977513 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.977794 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.978033 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.978327 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.978567 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.978843 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.979711 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.980174 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.980576 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.980962 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.981337 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.981728 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.981967 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.982239 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.982525 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.982762 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.982969 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.983312 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.983498 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.983716 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.983943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.984187 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.984664 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.984789 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.984964 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.985167 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.985555 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.985688 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.985937 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.986193 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.986470 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.986721 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.990961 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.990961 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.21/identity {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.990961 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.990961 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.990961 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.990961 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.990961 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.990961 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.992511 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.992511 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.992511 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.992511 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.992511 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.992511 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.992511 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.992511 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.993627 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.993627 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.993627 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.993627 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.993627 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.993627 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.993627 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.993627 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.995244 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.995244 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.995244 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.995244 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.995244 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.995244 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.995244 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.995244 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.996895 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.996895 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.996895 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.996895 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.996895 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.996895 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.996895 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.996895 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.997809 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.997809 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.997809 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.997809 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.997809 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.997809 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.997809 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.999360 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.999360 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.999360 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.999360 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.999360 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.999360 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.999360 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:30.999360 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.000794 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.000794 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.000794 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.000794 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.000794 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.000794 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.001532 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.001532 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.001532 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.002087 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.002087 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.002087 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.002849 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.002849 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.002849 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.003546 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.003546 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.003546 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.004639 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.004639 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.004639 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.004639 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.004639 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.004639 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.010776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.010776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.010776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.010776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.010776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.010776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.010776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.010776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.011791 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.011791 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.011791 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.011791 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.011791 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.011791 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.011791 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.011791 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.012651 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.012651 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.012651 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.012651 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.012651 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.012651 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.012651 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.012651 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.013510 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.013510 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.013510 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.013510 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.013510 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.013510 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.013510 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.013510 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.014618 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.014618 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.014618 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.014618 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.014618 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.014618 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.014618 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.014618 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.015536 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:150:199'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.015536 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.015536 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.015536 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.015536 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.015859 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.015859 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.016066 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.016321 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.016541 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.016756 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.017067 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.017288 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.017539 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.017761 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.017938 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.018113 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.018346 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.018593 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.018806 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.019046 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.019254 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.019497 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.019728 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.019888 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 04:02:31.020517 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=101555) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 08 04:02:31.020741 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 04:02:31.020890 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 04:02:31.021765 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 04:02:31.021928 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 04:02:31.022059 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 04:02:31.022207 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.022349 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.022536 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.022932 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.022932 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031110 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031110 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031110 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031110 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031110 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031110 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031110 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031110 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031740 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031740 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031740 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031740 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031740 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031740 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031740 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] config_source = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.031740 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032276 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032276 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] debug = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032276 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032276 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032276 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032276 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032703 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032703 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032703 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032703 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032703 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032703 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032703 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.032703 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033237 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033237 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033237 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033237 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033237 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033237 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033237 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] host = dv-cinder-783643-4-iscsi {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033237 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.033775 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.034232 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.034232 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.034232 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.034232 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_dir = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.034232 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.034232 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_options = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.034232 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.034665 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.034929 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.036020 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.036368 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.036548 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.036928 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.037420 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.037744 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.041371 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.041371 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.042131 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.042287 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.042826 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.042826 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.042826 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.043195 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.043195 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.043448 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.043448 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.043642 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.046345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.046345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.046345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.046345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.046345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.046345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.046345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.046345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.046345 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047603 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047603 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.047603 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.048671 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.050355 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.051030 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.053943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.053943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_journal = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.053943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_json = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.053943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.053943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.053943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.053943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.053943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.053943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.054554 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.054554 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 04:02:31.054554 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.054554 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.054554 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.054554 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.054554 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.054554 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055006 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055464 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055464 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055464 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055642 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055707 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055978 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.055978 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.056126 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.056297 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.056452 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.056608 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.056792 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.058215 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.058215 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.058215 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.058215 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.21/identity {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.058215 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.058639 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.058639 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.058639 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.058847 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.058924 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.059031 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.059187 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.059343 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.059499 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.059655 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.059811 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.060009 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.062393 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.064144 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.064330 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.064506 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.064680 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.064851 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.065020 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.065214 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.065348 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.065666 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.065836 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.065996 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.066630 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.066876 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.067883 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.067883 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.068113 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.068113 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.068334 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.068504 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.068665 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.068926 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.069093 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.069266 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.069423 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.069581 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.069737 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.069894 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.070051 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.070251 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.070636 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.070806 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.070948 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.071297 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.072335 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.072582 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.072864 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.073036 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.073196 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.073357 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.073707 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.073876 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.074035 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.074274 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.074571 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.074828 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.075048 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.075223 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.075381 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.075623 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.076059 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.076234 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.076504 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.077052 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.077199 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.077344 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.077506 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.077777 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.077975 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.078138 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.078294 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.078450 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.078658 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.078917 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.079130 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.079257 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:02:31.079386 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.079523 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.079648 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.079771 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.079894 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.080016 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.080138 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.080299 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.080464 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.080619 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.080777 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.080933 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.081095 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.081262 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.081418 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.081574 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.081728 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.081883 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.082038 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.082192 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.082347 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.082517 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.082667 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.082822 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.082984 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.083150 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.083306 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.083461 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.083599 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.083797 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.084363 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.084363 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.084363 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.084691 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.084691 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.084888 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.084888 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.085093 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.085200 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.085325 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.085482 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.21/identity {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.085637 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.085837 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.085943 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.086079 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.086235 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.086390 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091103 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091103 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091103 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091103 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091103 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091103 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091103 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091103 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.091776 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092326 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092326 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092326 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092326 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092326 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092326 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092326 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092326 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092874 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092874 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092874 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092874 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092874 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092874 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092874 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.092874 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.093396 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.093396 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.093396 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.093396 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.093396 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.093396 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.093794 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.093794 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.093934 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.094010 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.094157 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.094347 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.094505 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.094659 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.094817 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.094970 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.095138 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.095293 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.095450 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.095608 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.095765 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.095945 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.096102 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.096265 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.096434 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.096610 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.096752 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.096907 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.097064 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.097220 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.097388 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.097545 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.097701 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.097857 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.098014 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.098170 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.098335 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.098548 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.098702 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.098865 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.099031 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.099129 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.099302 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.099456 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.099610 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.099766 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.099914 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.100074 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.100241 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.100396 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.100979 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.101153 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.101314 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.101476 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.101648 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.101808 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.101958 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.102118 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.102277 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.102435 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.102659 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.102819 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.102977 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.103141 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.103298 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.103455 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.103612 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.103781 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.103981 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.104654 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.104814 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.104970 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.105128 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.105289 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.105450 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.105669 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.105777 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.105930 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.106095 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.106260 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:150:199'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.106429 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.106620 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.106788 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.107032 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.107174 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.107310 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.107443 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.107578 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.107711 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.107861 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.107993 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.108126 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.108258 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.108421 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.108581 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.108737 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.108894 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.109050 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.109208 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.109363 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.109520 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.109675 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.109832 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 04:02:31.109982 dv-cinder-783643-4-iscsi neutron-server[101555]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 04:02:31.210141 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 47448) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:02:31.219189 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [-] 10.222.0.21 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0068688 Nov 08 04:02:42.705780 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6fccf3a-d31a-4fe7-8a23-825c84e08ac4 None None] get_active_networks_info from dv-cinder-783643-4-iscsi {{(pid=101666) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 08 04:02:42.764171 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6fccf3a-d31a-4fe7-8a23-825c84e08ac4 None None] No non-hosted networks {{(pid=101666) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 08 04:02:42.778588 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.agentschedulers_db [None req-f6fccf3a-d31a-4fe7-8a23-825c84e08ac4 None None] DHCP Agent not found on host dv-cinder-783643-4-iscsi {{(pid=101666) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 08 04:02:42.887498 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7a4364e4-458b-459c-842f-acd609f0616c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-703218'] for agent, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:45.121061 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8504ea06-429f-48a6-9b45-60f78723148d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-703218'] for agent, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:45.153301 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.db.api [None req-febe0731-0182-4efc-b539-e0b5a5f5ebe7 None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-783643-4-iscsi {{(pid=101666) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 08 04:02:45.154049 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG oslo_db.api [None req-febe0731-0182-4efc-b539-e0b5a5f5ebe7 None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 08 04:02:45.770446 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-febe0731-0182-4efc-b539-e0b5a5f5ebe7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:45.946409 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-703218'] for agent, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:47.580979 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-703218'] for agent, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:48.365361 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-703218'] for agent, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:48.366476 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.367088 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.368116 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.368692 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.369910 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.370729 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.372094 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.372094 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.372094 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.372729 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.373316 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.373857 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:48.374516 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-783643-4-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:02:48.382342 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-783643-4-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:02:48.771835 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 47540) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:02:49.285873 dv-cinder-783643-4-iscsi neutron-server[101665]: WARNING oslo_policy.policy [None req-f0e2cedd-8ccf-424c-a2f2-3b4f96203623 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 04:02:49.286473 dv-cinder-783643-4-iscsi neutron-server[101665]: WARNING oslo_policy.policy [None req-f0e2cedd-8ccf-424c-a2f2-3b4f96203623 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 04:02:49.520317 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [None req-f0e2cedd-8ccf-424c-a2f2-3b4f96203623 admin admin] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:02:49.534502 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f0e2cedd-8ccf-424c-a2f2-3b4f96203623 admin admin] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7486022 Nov 08 04:02:49.685465 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.db.l3_hamode_db [None req-d75812bb-8037-483b-a297-a209fb5d3699 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 08 04:02:49.770956 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d75812bb-8037-483b-a297-a209fb5d3699 None None] Routers set() bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:02:49.771431 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d75812bb-8037-483b-a297-a209fb5d3699 None None] Router IDs set() for agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 08 04:02:52.022162 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 47556) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:02:52.329620 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-8d93b642-a620-4d33-91bc-fe06fc14b178 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'name': 'shared-default-subnetpool-v4', 'shared': True, 'is_default': True}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:02:52.425010 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.policy [None req-8d93b642-a620-4d33-91bc-fe06fc14b178 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=101665) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 08 04:02:52.471401 dv-cinder-783643-4-iscsi neutron-server[101665]: WARNING oslo_policy.policy [None req-8d93b642-a620-4d33-91bc-fe06fc14b178 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 04:02:52.471764 dv-cinder-783643-4-iscsi neutron-server[101665]: WARNING oslo_policy.policy [None req-8d93b642-a620-4d33-91bc-fe06fc14b178 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 04:02:52.481283 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.quota [None req-8d93b642-a620-4d33-91bc-fe06fc14b178 admin admin] Loaded quota_driver: . Nov 08 04:02:52.636518 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-8d93b642-a620-4d33-91bc-fe06fc14b178 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785439222972', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785439223403', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785439210738', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785439205166', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785438532804', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8785438986902', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1602291', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1956310', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-865379', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1037467'] for rbac-policy, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:52.839988 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-8d93b642-a620-4d33-91bc-fe06fc14b178 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:52.841152 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-8d93b642-a620-4d33-91bc-fe06fc14b178 admin admin] 10.222.0.21 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.8179910 Nov 08 04:02:55.507066 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 47568) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:02:55.990672 dv-cinder-783643-4-iscsi neutron-server[101664]: WARNING oslo_policy.policy [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 04:02:55.991265 dv-cinder-783643-4-iscsi neutron-server[101664]: WARNING oslo_policy.policy [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 04:02:56.212095 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Request body: {'network': {'admin_state_up': True, 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'name': 'private', 'project_id': '6fe8110cd6254e09be7068976ea18ac4'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:02:56.214331 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.quota [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Loaded quota_driver: . Nov 08 04:02:56.346315 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Made reservation on behalf of 6fe8110cd6254e09be7068976ea18ac4 for: {'network': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:02:56.416751 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.policy [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=101664) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 08 04:02:56.463406 dv-cinder-783643-4-iscsi neutron-server[101664]: WARNING oslo_policy.policy [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 04:02:56.463773 dv-cinder-783643-4-iscsi neutron-server[101664]: WARNING oslo_policy.policy [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 08 04:02:56.474336 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:56.494309 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:56.603372 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:56.665875 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:56.685692 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] vlan segment allocate from pool success with {'vlan_id': 157, 'physical_network': 'physnet1'} {{(pid=101664) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:02:56.713273 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8785436166440', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:56.713844 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Unsubscribe: segment precommit_create {{(pid=101664) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 08 04:02:56.714365 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.segments_db [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Added segment facd605a-10f7-4428-ab75-489b66d64fa1 of type vlan for network 1007f26c-b619-4294-b67e-7849169bdd34 Nov 08 04:02:56.734686 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15941693-512c-4f86-b2ec-b8596f2ccd79,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:02:56.769424 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.769771 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.770106 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.770442 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.770779 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.771137 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.771459 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.771791 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.772126 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.772443 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.772755 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.773064 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Tracked resource versions report: Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: pushed versions: Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: { 'AddressGroup': {'1.2'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'ConntrackHelper': {'1.0'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Log': {'1.0'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Network': {'1.1'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Port': {'1.7'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'PortForwarding': {'1.2'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'QosPolicy': {'1.10'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SecurityGroup': {'1.5'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SecurityGroupRule': {'1.2'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SubPort': {'1.0'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Subnet': {'1.1'}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Trunk': {'1.1'}} Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: consumer versions: Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: { DHCP agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: L3 agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: Metadata agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: Metering agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: Open vSwitch agent@dv-cinder-783643-4-iscsi: { 'AddressGroup': '1.2', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'ConntrackHelper': '1.0', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Log': '1.0', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Network': '1.1', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Port': '1.7', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'PortForwarding': '1.2', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'QosPolicy': '1.10', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SecurityGroup': '1.5', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SecurityGroupRule': '1.2', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SubPort': '1.0', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Subnet': '1.1', Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Trunk': '1.1'}} Nov 08 04:02:56.774166 dv-cinder-783643-4-iscsi neutron-server[101664]: {{(pid=101664) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 04:02:56.843338 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:56.934595 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:56.935837 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:02:56.936603 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:02:57.033877 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] Pushing event updated for resources: {'Network': ['ID=1007f26c-b619-4294-b67e-7849169bdd34,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:02:57.041597 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-5e063524-a259-4543-b2a7-3e1250115fb3 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.5313375 Nov 08 04:02:57.053390 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 1007f26c-b619-4294-b67e-7849169bdd34 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:02:59.919648 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 47590) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:03:00.309775 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc4a745b-79c8-4c4e-9478-d35030059b71 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:03:00.311183 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-cc4a745b-79c8-4c4e-9478-d35030059b71 admin admin] 10.222.0.21 "GET /v2.0/networks/1007f26c-b619-4294-b67e-7849169bdd34 HTTP/1.1" status: 200 len: 825 time: 0.3905568 Nov 08 04:03:00.357160 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-6f38a6c5-3839-4f9c-8ae1-8e1892d561f9 admin admin] 10.222.0.21 "GET /v2.0/subnetpools/54198234-8ef7-4782-85f9-e10b64ce8cd0 HTTP/1.1" status: 200 len: 734 time: 0.0396280 Nov 08 04:03:00.366668 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Request body: {'subnet': {'name': 'private-subnet', 'subnetpool_id': '54198234-8ef7-4782-85f9-e10b64ce8cd0', 'gateway_ip': '172.20.0.1', 'ip_version': 4, 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:03:00.431509 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Made reservation on behalf of 6fe8110cd6254e09be7068976ea18ac4 for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:03:00.433801 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:00.758017 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:00.825399 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Checking segment: {'id': 'facd605a-10f7-4428-ab75-489b66d64fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:03:00.825772 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Network hostable DHCP agents. Network: 1007f26c-b619-4294-b67e-7849169bdd34, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:03:00.830245 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4e98dd0f-b55a-4f27-ad1b-60c004f8751b,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:00.888988 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Network 1007f26c-b619-4294-b67e-7849169bdd34 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:03:00.945996 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 1007f26c-b619-4294-b67e-7849169bdd34) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:03:00.951037 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:03:00.951639 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:00.956526 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44e19a4a-4685-463c-b955-56c5f2d96363 None None] Network 1007f26c-b619-4294-b67e-7849169bdd34 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:03:01.023088 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-317686dc-db4f-481d-8e3d-c0be1c2a7392 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.6596262 Nov 08 04:03:01.301905 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp69aa137b-4136-5a6b-bf5e-deeb8c067c65-1007f26c-b619-4294-b67e-7849169bdd34', 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'fixed_ips': [{'subnet_id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b'}]}} from dv-cinder-783643-4-iscsi. {{(pid=101666) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 04:03:01.303403 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:01.615326 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.db_base_plugin_common [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Allocated IP 172.20.0.2 (1007f26c-b619-4294-b67e-7849169bdd34/4e98dd0f-b55a-4f27-ad1b-60c004f8751b/21e234ce-c50d-4281-8e38-2cca18b6ee27) {{(pid=101666) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:03:01.812799 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Publish callbacks [] for port, precommit_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:01.901423 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:01.976648 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Network 1007f26c-b619-4294-b67e-7849169bdd34 is already hosted by enough agents. {{(pid=101666) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:03:01.981997 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.base_scheduler [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Resources bound (agent type, host, resource id): {{(pid=101666) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:03:01.987499 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Pushing event updated for resources: {'Port': ['ID=21e234ce-c50d-4281-8e38-2cca18b6ee27,revision_number=1']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:01.995738 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Received port after_create {{(pid=101666) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:03:01.997664 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:01.998027 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:01.998372 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:01.998731 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:01.999063 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:01.999391 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:01.999718 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:02.000045 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:02.001304 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:02.001650 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:02.001987 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:02.002313 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Tracked resource versions report: Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: pushed versions: Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: { 'AddressGroup': {'1.2'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'ConntrackHelper': {'1.0'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Log': {'1.0'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Network': {'1.1'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Port': {'1.7'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'PortForwarding': {'1.2'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'QosPolicy': {'1.10'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SecurityGroup': {'1.5'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SecurityGroupRule': {'1.2'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SubPort': {'1.0'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Subnet': {'1.1'}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Trunk': {'1.1'}} Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: consumer versions: Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: { DHCP agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: L3 agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: Metadata agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: Metering agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: Open vSwitch agent@dv-cinder-783643-4-iscsi: { 'AddressGroup': '1.2', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'ConntrackHelper': '1.0', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Log': '1.0', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Network': '1.1', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Port': '1.7', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'PortForwarding': '1.2', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'QosPolicy': '1.10', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SecurityGroup': '1.5', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SecurityGroupRule': '1.2', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SubPort': '1.0', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Subnet': '1.1', Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Trunk': '1.1'}} Nov 08 04:03:02.003413 dv-cinder-783643-4-iscsi neutron-server[101666]: {{(pid=101666) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 04:03:02.077802 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Attempting to bind port 21e234ce-c50d-4281-8e38-2cca18b6ee27 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:03:02.078184 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Attempting to bind port 21e234ce-c50d-4281-8e38-2cca18b6ee27 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': 'facd605a-10f7-4428-ab75-489b66d64fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:03:02.078647 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Attempting to bind port 21e234ce-c50d-4281-8e38-2cca18b6ee27 on network 1007f26c-b619-4294-b67e-7849169bdd34 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:03:02.083488 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 2, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:03:02.083875 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Checking segment: {'id': 'facd605a-10f7-4428-ab75-489b66d64fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:03:02.084361 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:02.084743 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Bound using segment: {'id': 'facd605a-10f7-4428-ab75-489b66d64fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:03:02.085233 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Bound port: 21e234ce-c50d-4281-8e38-2cca18b6ee27, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'facd605a-10f7-4428-ab75-489b66d64fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:03:02.085641 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:02.148051 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] For port 21e234ce-c50d-4281-8e38-2cca18b6ee27, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:03:02.170838 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] For port 21e234ce-c50d-4281-8e38-2cca18b6ee27, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=21e234ce-c50d-4281-8e38-2cca18b6ee27,segment=NetworkSegment(facd605a-10f7-4428-ab75-489b66d64fa1),segment_id=facd605a-10f7-4428-ab75-489b66d64fa1)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:03:02.243899 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:02.298323 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3801140e-aa85-42b2-a1ea-da60e436d522 None None] Pushing event updated for resources: {'Port': ['ID=21e234ce-c50d-4281-8e38-2cca18b6ee27,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:04.158846 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 47598) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:03:04.480189 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [None req-e13ead6c-8332-4c81-9f87-feefe3034653 admin admin] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:03:04.494564 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-e13ead6c-8332-4c81-9f87-feefe3034653 admin admin] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3212941 Nov 08 04:03:06.967411 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 47606) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:03:07.279254 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [None req-85799af9-b3df-44ba-b50c-d91dc6781aa1 admin admin] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:03:07.280232 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-85799af9-b3df-44ba-b50c-d91dc6781aa1 admin admin] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3118348 Nov 08 04:03:10.003198 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 47620) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:03:10.311882 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-40d2918b-e8f4-4738-8982-e1f6c4a5ff9f admin admin] Request body: {'router': {'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'admin_state_up': True, 'name': 'router1'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:03:10.397742 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-40d2918b-e8f4-4738-8982-e1f6c4a5ff9f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-701463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7538'] for router, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:10.399975 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-40d2918b-e8f4-4738-8982-e1f6c4a5ff9f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-701603', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-688686', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-770197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7531'] for router, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:10.535258 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-40d2918b-e8f4-4738-8982-e1f6c4a5ff9f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:10.609867 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-40d2918b-e8f4-4738-8982-e1f6c4a5ff9f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-701612', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891'] for router, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:10.673818 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-40d2918b-e8f4-4738-8982-e1f6c4a5ff9f admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:10.675119 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-40d2918b-e8f4-4738-8982-e1f6c4a5ff9f admin admin] 10.222.0.21 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6707840 Nov 08 04:03:11.370989 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b35affe8-a228-483f-bfc6-5fa74cc49886 None None] Network 1007f26c-b619-4294-b67e-7849169bdd34 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:03:11.444366 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-cb990ce3-3ffe-42bf-ab88-a5d18b4dfa29 None None] Provisioning complete for port 21e234ce-c50d-4281-8e38-2cca18b6ee27 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:03:11.444749 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cb990ce3-3ffe-42bf-ab88-a5d18b4dfa29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:11.655967 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cb990ce3-3ffe-42bf-ab88-a5d18b4dfa29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:11.704684 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-cb990ce3-3ffe-42bf-ab88-a5d18b4dfa29 None None] For port 21e234ce-c50d-4281-8e38-2cca18b6ee27, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=21e234ce-c50d-4281-8e38-2cca18b6ee27,segment=NetworkSegment(facd605a-10f7-4428-ab75-489b66d64fa1),segment_id=facd605a-10f7-4428-ab75-489b66d64fa1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:03:11.763507 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cb990ce3-3ffe-42bf-ab88-a5d18b4dfa29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:11.813008 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb990ce3-3ffe-42bf-ab88-a5d18b4dfa29 None None] Pushing event updated for resources: {'Port': ['ID=21e234ce-c50d-4281-8e38-2cca18b6ee27,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:11.883026 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8b9be831-f466-4276-b754-71ec7b390f66 None None] Provisioning complete for port 21e234ce-c50d-4281-8e38-2cca18b6ee27 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:03:11.883394 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8b9be831-f466-4276-b754-71ec7b390f66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:12.070508 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 21e234ce-c50d-4281-8e38-2cca18b6ee27 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:03:12.118831 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 21e234ce-c50d-4281-8e38-2cca18b6ee27 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:03:12.119198 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:12.666450 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-51b4fbeb-a928-4787-b51e-09be5e089f51 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:13.180924 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 47628) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:03:13.485702 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [None req-079b5133-43d8-4aa0-86cd-daf8fdaa51b7 admin admin] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101664) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:03:13.486721 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-079b5133-43d8-4aa0-86cd-daf8fdaa51b7 admin admin] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3048308 Nov 08 04:03:15.117000 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b060b24a-fdf6-4eaf-9f0f-04abe4001a09 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:15.888389 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:15.994275 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 47646) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:03:16.121147 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Request body: {'network': {'admin_state_up': True, 'provider:physical_network': 'physnet1', 'router:external': True, 'provider:network_type': 'flat', 'is_default': True, 'name': 'public'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:03:16.225269 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Made reservation on behalf of d4153515b8704248acfc9ad6fd8dd2fc for: {'network': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:03:16.228254 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:16.236348 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:16.305709 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:16.368095 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:16.382782 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Reserving flat network on physical network physnet1 {{(pid=101664) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 08 04:03:16.403209 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96801562-d6e2-4c03-ba25-41e20b3ceb43,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:16.407153 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:16.407553 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.segments_db [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Added segment 9577efe5-3511-40fe-9ebe-e6ea7e63ac49 of type flat for network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 Nov 08 04:03:16.454562 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:16.528531 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:16.530122 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:03:16.530797 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:16.590760 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] Pushing event updated for resources: {'Network': ['ID=5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:16.600257 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:03:16.610886 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-142f00f5-9982-40b4-9de4-87bff5f63da3 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.6155097 Nov 08 04:03:17.511425 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:18.397070 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:18.936502 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 47664) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:03:19.081473 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54a32481-ebfe-46b1-b2b1-993b94410362 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:03:19.082986 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-54a32481-ebfe-46b1-b2b1-993b94410362 admin admin] 10.222.0.21 "GET /v2.0/subnets/4e98dd0f-b55a-4f27-ad1b-60c004f8751b HTTP/1.1" status: 200 len: 849 time: 0.1455576 Nov 08 04:03:19.256292 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ec2251c4-c66e-4eda-84f6-8cc9167428f7 admin admin] 10.222.0.21 "GET /v2.0/routers/37084be3-271f-42a7-9fd2-1ca8fd139b90 HTTP/1.1" status: 200 len: 704 time: 0.1670125 Nov 08 04:03:19.528807 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:19.822296 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Allocated IP 172.20.0.1 (1007f26c-b619-4294-b67e-7849169bdd34/4e98dd0f-b55a-4f27-ad1b-60c004f8751b/ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:03:20.023481 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:20.145960 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:20.184645 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Network 1007f26c-b619-4294-b67e-7849169bdd34 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:03:20.206574 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:03:20.241151 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:03:20.241761 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-703278'] for router_interface, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:20.348754 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Pushing event updated for resources: {'Port': ['ID=ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:20.386762 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.387129 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.387466 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.387792 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.388116 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.388453 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.388778 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.389112 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.389447 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.389763 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.390076 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.390386 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Tracked resource versions report: Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: pushed versions: Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: { 'AddressGroup': {'1.2'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'ConntrackHelper': {'1.0'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Log': {'1.0'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Network': {'1.1'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Port': {'1.7'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'PortForwarding': {'1.2'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'QosPolicy': {'1.10'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SecurityGroup': {'1.5'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SecurityGroupRule': {'1.2'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SubPort': {'1.0'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Subnet': {'1.1'}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Trunk': {'1.1'}} Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: consumer versions: Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: { DHCP agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: L3 agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: Metadata agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: Metering agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: Open vSwitch agent@dv-cinder-783643-4-iscsi: { 'AddressGroup': '1.2', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'ConntrackHelper': '1.0', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Log': '1.0', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Network': '1.1', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Port': '1.7', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'PortForwarding': '1.2', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'QosPolicy': '1.10', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SecurityGroup': '1.5', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SecurityGroupRule': '1.2', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SubPort': '1.0', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Subnet': '1.1', Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Trunk': '1.1'}} Nov 08 04:03:20.391454 dv-cinder-783643-4-iscsi neutron-server[101665]: {{(pid=101665) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 04:03:20.430632 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-5fb6996c-4abe-451a-87ab-238ff39c73c4 None None] Provisioning complete for port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:03:20.436865 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5fb6996c-4abe-451a-87ab-238ff39c73c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:20.464517 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-5fb6996c-4abe-451a-87ab-238ff39c73c4 None None] Port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:03:20.523589 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:20.727574 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:20.774091 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:20.774830 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530987', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-703418'] for router_interface, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:20.896811 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Pushing event updated for resources: {'Port': ['ID=ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:20.937795 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Network 1007f26c-b619-4294-b67e-7849169bdd34 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:03:20.939101 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:03:20.981103 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 5 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:03:21.162870 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Router 37084be3-271f-42a7-9fd2-1ca8fd139b90 is scheduled to L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 with binding_index 1 {{(pid=101665) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 04:03:21.187636 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-30b5485f-1729-4a4c-8ce4-f77bf6597657 None None] Provisioning complete for port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:03:21.187997 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-30b5485f-1729-4a4c-8ce4-f77bf6597657 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:21.258468 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:03:21.263281 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-30b5485f-1729-4a4c-8ce4-f77bf6597657 None None] Port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:03:21.270221 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ff773c18-336c-4e5c-ae5c-5144f0668c95 admin admin] 10.222.0.21 "PUT /v2.0/routers/37084be3-271f-42a7-9fd2-1ca8fd139b90/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.0014675 Nov 08 04:03:21.270330 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Sync routers for ids ['37084be3-271f-42a7-9fd2-1ca8fd139b90'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:03:21.283422 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Routers {'37084be3-271f-42a7-9fd2-1ca8fd139b90'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:03:21.284272 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:03:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['37084be3-271f-42a7-9fd2-1ca8fd139b90'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:03:21.471404 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Set router 37084be3-271f-42a7-9fd2-1ca8fd139b90 gateway port host: None {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:03:21.891831 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'name': 'router1', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:03:10Z', 'updated_at': '2021-11-08T04:03:20Z', 'revision_number': 2, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'gw_port_host': None, '_interfaces': [{'id': 'ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8', 'name': '', 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'mac_address': 'fa:16:3e:0a:61:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:03:19Z', 'updated_at': '2021-11-08T04:03:20Z', 'revision_number': 2, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'subnets': [{'id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '54198234-8ef7-4782-85f9-e10b64ce8cd0'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:03:21.941500 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Checking router: 37084be3-271f-42a7-9fd2-1ca8fd139b90 for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:03:21.941884 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Updating router 37084be3-271f-42a7-9fd2-1ca8fd139b90 port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 binding host dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:03:21.990422 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:22.491319 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Publish callbacks [] for port, precommit_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:22.551004 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:22.705795 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Pushing event updated for resources: {'Port': ['ID=ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8,revision_number=3']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:22.723710 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Attempting to bind port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:03:22.724023 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Attempting to bind port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': 'facd605a-10f7-4428-ab75-489b66d64fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34'}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:03:22.724470 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Attempting to bind port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 on network 1007f26c-b619-4294-b67e-7849169bdd34 {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:03:22.728468 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.728818 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.729154 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.729628 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.729958 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.730286 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.730645 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.730970 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.731297 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.731615 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.731934 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.732325 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Tracked resource versions report: Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: pushed versions: Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: { 'AddressGroup': {'1.2'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'ConntrackHelper': {'1.0'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Log': {'1.0'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Network': {'1.1'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Port': {'1.7'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'PortForwarding': {'1.2'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'QosPolicy': {'1.10'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SecurityGroup': {'1.5'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SecurityGroupRule': {'1.2'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SubPort': {'1.0'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Subnet': {'1.1'}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Trunk': {'1.1'}} Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: consumer versions: Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: { DHCP agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: L3 agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: Metadata agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: Metering agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: Open vSwitch agent@dv-cinder-783643-4-iscsi: { 'AddressGroup': '1.2', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'ConntrackHelper': '1.0', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Log': '1.0', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Network': '1.1', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Port': '1.7', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'PortForwarding': '1.2', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'QosPolicy': '1.10', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SecurityGroup': '1.5', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SecurityGroupRule': '1.2', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SubPort': '1.0', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Subnet': '1.1', Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Trunk': '1.1'}} Nov 08 04:03:22.733416 dv-cinder-783643-4-iscsi neutron-server[101667]: {{(pid=101667) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 04:03:22.739395 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 3, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:03:22.739814 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Checking segment: {'id': 'facd605a-10f7-4428-ab75-489b66d64fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101667) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:03:22.740283 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:22.740727 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Bound using segment: {'id': 'facd605a-10f7-4428-ab75-489b66d64fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34'} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:03:22.741166 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Bound port: ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'facd605a-10f7-4428-ab75-489b66d64fa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 157, 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34'}}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:03:22.741604 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:22.800818 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-d4106021-1db4-44c4-a591-882182b9a449 None None] Provisioning complete for port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:03:22.801378 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d4106021-1db4-44c4-a591-882182b9a449 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:22.808656 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] For port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101667) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:03:22.827581 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] For port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8,segment=NetworkSegment(facd605a-10f7-4428-ab75-489b66d64fa1),segment_id=facd605a-10f7-4428-ab75-489b66d64fa1)] {{(pid=101667) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:03:22.835443 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-d4106021-1db4-44c4-a591-882182b9a449 None None] Port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:03:22.900658 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:22.956882 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Routers {'37084be3-271f-42a7-9fd2-1ca8fd139b90'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:03:22.957511 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:03:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['37084be3-271f-42a7-9fd2-1ca8fd139b90'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:03:22.995350 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde051ea-d7ab-4909-beaf-ea83df33c834 None None] Pushing event updated for resources: {'Port': ['ID=ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8,revision_number=4']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:23.054682 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] Set router 37084be3-271f-42a7-9fd2-1ca8fd139b90 gateway port host: None {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:03:23.161485 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-fa017d84-b685-4f70-99f1-84b8883f4404 None None] Provisioning complete for port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:03:23.161944 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-fa017d84-b685-4f70-99f1-84b8883f4404 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:23.239303 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-fa017d84-b685-4f70-99f1-84b8883f4404 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:23.262920 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'name': 'router1', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:03:10Z', 'updated_at': '2021-11-08T04:03:20Z', 'revision_number': 2, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'gw_port_host': None, '_interfaces': [{'id': 'ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8', 'name': '', 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'mac_address': 'fa:16:3e:0a:61:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:03:19Z', 'updated_at': '2021-11-08T04:03:22Z', 'revision_number': 4, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'subnets': [{'id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '54198234-8ef7-4782-85f9-e10b64ce8cd0'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:03:23.274237 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-fa017d84-b685-4f70-99f1-84b8883f4404 None None] For port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8,segment=NetworkSegment(facd605a-10f7-4428-ab75-489b66d64fa1),segment_id=facd605a-10f7-4428-ab75-489b66d64fa1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:03:23.288535 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a100a2cf-143a-4fb2-9d93-de81d1bfff49 None None] The sync data for ids ['37084be3-271f-42a7-9fd2-1ca8fd139b90'] in dv-cinder-783643-4-iscsi is: [{'id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'name': 'router1', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:03:10Z', 'updated_at': '2021-11-08T04:03:20Z', 'revision_number': 2, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'gw_port_host': None, '_interfaces': [{'id': 'ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8', 'name': '', 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'mac_address': 'fa:16:3e:0a:61:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:03:19Z', 'updated_at': '2021-11-08T04:03:22Z', 'revision_number': 4, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'subnets': [{'id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '54198234-8ef7-4782-85f9-e10b64ce8cd0'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:03:23.357030 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-fa017d84-b685-4f70-99f1-84b8883f4404 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:23.408119 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa017d84-b685-4f70-99f1-84b8883f4404 None None] Pushing event updated for resources: {'Port': ['ID=ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:23.606530 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 47678) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:03:23.714822 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ada9520-5282-4211-84e8-3746492552fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:03:23.716129 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-6ada9520-5282-4211-84e8-3746492552fc admin admin] 10.222.0.21 "GET /v2.0/networks/5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 HTTP/1.1" status: 200 len: 842 time: 0.1085467 Nov 08 04:03:23.725971 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Request body: {'subnet': {'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'enable_dhcp': False, 'name': 'public-subnet', 'ip_version': 4, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:03:23.831191 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Made reservation on behalf of d4153515b8704248acfc9ad6fd8dd2fc for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:03:23.833517 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:24.166191 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.objects.ports [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=101664) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 08 04:03:24.166565 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:24.218594 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d4daf4b1-2c47-4c16-a8ea-4d93b75219c9,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:24.227243 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:03:24.227594 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Network hostable DHCP agents. Network: 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:03:24.316952 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:03:24.385169 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:03:24.389650 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:03:24.390449 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:24.396272 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48259c25-bbf4-4726-b9ed-bf62109e6d20 None None] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:03:24.480136 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-ba12715a-ca71-4645-9725-60517d62b460 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7573166 Nov 08 04:03:24.532454 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fd3e625-a462-44a2-bea2-d702457f4ed8 None None] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:03:26.884020 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 47686) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:03:27.015939 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-e3bfb03b-1591-4a99-8f8c-79e86706c2f2 admin admin] 10.222.0.21 "GET /v2.0/routers/37084be3-271f-42a7-9fd2-1ca8fd139b90 HTTP/1.1" status: 200 len: 710 time: 0.1307580 Nov 08 04:03:27.105238 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b286f8ec-c384-42a6-a20a-5d4be1775577 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:03:27.106561 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b286f8ec-c384-42a6-a20a-5d4be1775577 admin admin] 10.222.0.21 "GET /v2.0/networks/5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 HTTP/1.1" status: 200 len: 886 time: 0.0845280 Nov 08 04:03:27.116545 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:03:27.357435 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:27.681481 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:27.759287 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:27.883875 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Allocated IP 172.27.2.91 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/96deb08e-345e-423e-96c2-9eccc5f3886d) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:03:27.979822 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:28.060152 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:28.098915 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:03:28.103660 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:03:28.107033 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:03:28.111936 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Pushing event updated for resources: {'Port': ['ID=96deb08e-345e-423e-96c2-9eccc5f3886d,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:28.533412 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:28.731926 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-688640', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-701589', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-7517'] for router, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:28.736915 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-688649', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-688882', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-701598'] for router, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:28.847032 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Router 37084be3-271f-42a7-9fd2-1ca8fd139b90 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:03:28.954576 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:03:28.959036 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] Publish callbacks [] for router, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:28.960213 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-fba80f99-0c1b-4f59-9ea1-5e9f6915da6c admin admin] 10.222.0.21 "PUT /v2.0/routers/37084be3-271f-42a7-9fd2-1ca8fd139b90 HTTP/1.1" status: 200 len: 889 time: 1.8471818 Nov 08 04:03:30.103270 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:03:30.153118 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:03:30.153486 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:30.196437 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Sync routers for ids ['37084be3-271f-42a7-9fd2-1ca8fd139b90'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:03:30.210358 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Routers {'37084be3-271f-42a7-9fd2-1ca8fd139b90'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:03:30.211659 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:03:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['37084be3-271f-42a7-9fd2-1ca8fd139b90'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:03:30.442100 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Set router 37084be3-271f-42a7-9fd2-1ca8fd139b90 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:03:30.838035 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'name': 'router1', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '96deb08e-345e-423e-96c2-9eccc5f3886d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:03:10Z', 'updated_at': '2021-11-08T04:03:28Z', 'revision_number': 4, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'gw_port': {'id': '96deb08e-345e-423e-96c2-9eccc5f3886d', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:3f:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:03:27Z', 'updated_at': '2021-11-08T04:03:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8', 'name': '', 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'mac_address': 'fa:16:3e:0a:61:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:03:19Z', 'updated_at': '2021-11-08T04:03:23Z', 'revision_number': 5, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'subnets': [{'id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '54198234-8ef7-4782-85f9-e10b64ce8cd0'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:03:30.956386 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Checking router: 37084be3-271f-42a7-9fd2-1ca8fd139b90 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:03:30.956756 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Updating router 37084be3-271f-42a7-9fd2-1ca8fd139b90 port 96deb08e-345e-423e-96c2-9eccc5f3886d binding host dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:03:31.003304 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:31.319610 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Publish callbacks [] for port, precommit_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:31.391263 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:31.436628 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 47698) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:03:31.442886 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Attempting to bind port 96deb08e-345e-423e-96c2-9eccc5f3886d on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:03:31.443320 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Attempting to bind port 96deb08e-345e-423e-96c2-9eccc5f3886d by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:03:31.443612 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Attempting to bind port 96deb08e-345e-423e-96c2-9eccc5f3886d on network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:03:31.445982 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1efeebfc-498b-4ef3-8140-b24fc82aba54 None None] Pushing event updated for resources: {'Port': ['ID=96deb08e-345e-423e-96c2-9eccc5f3886d,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:31.451438 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 3, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:03:31.451814 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:03:31.452214 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:31.452598 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Bound using segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:03:31.453608 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Bound port: 96deb08e-345e-423e-96c2-9eccc5f3886d, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:03:31.453608 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:31.501816 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] For port 96deb08e-345e-423e-96c2-9eccc5f3886d, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:03:31.505012 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] For port 96deb08e-345e-423e-96c2-9eccc5f3886d, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=96deb08e-345e-423e-96c2-9eccc5f3886d,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:03:31.554566 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-5f46b6c0-72b8-4ebb-a802-c2c140fdc427 admin admin] 10.222.0.21 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1166995 Nov 08 04:03:31.580700 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:31.644649 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Routers {'37084be3-271f-42a7-9fd2-1ca8fd139b90'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:03:31.645277 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:03:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['37084be3-271f-42a7-9fd2-1ca8fd139b90'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:03:31.680314 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1efeebfc-498b-4ef3-8140-b24fc82aba54 None None] Pushing event updated for resources: {'Port': ['ID=96deb08e-345e-423e-96c2-9eccc5f3886d,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:31.761100 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] Set router 37084be3-271f-42a7-9fd2-1ca8fd139b90 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:03:31.969244 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'name': 'router1', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '96deb08e-345e-423e-96c2-9eccc5f3886d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:03:10Z', 'updated_at': '2021-11-08T04:03:28Z', 'revision_number': 4, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'gw_port': {'id': '96deb08e-345e-423e-96c2-9eccc5f3886d', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:3f:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:03:27Z', 'updated_at': '2021-11-08T04:03:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8', 'name': '', 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'mac_address': 'fa:16:3e:0a:61:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:03:19Z', 'updated_at': '2021-11-08T04:03:23Z', 'revision_number': 5, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'subnets': [{'id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '54198234-8ef7-4782-85f9-e10b64ce8cd0'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:03:31.995186 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fe8eefa-8e0c-4035-abae-b2462ed991f8 None None] The sync data for ids ['37084be3-271f-42a7-9fd2-1ca8fd139b90'] in dv-cinder-783643-4-iscsi is: [{'id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'name': 'router1', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '96deb08e-345e-423e-96c2-9eccc5f3886d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:03:10Z', 'updated_at': '2021-11-08T04:03:28Z', 'revision_number': 4, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'gw_port': {'id': '96deb08e-345e-423e-96c2-9eccc5f3886d', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:3f:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:03:27Z', 'updated_at': '2021-11-08T04:03:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8', 'name': '', 'network_id': '1007f26c-b619-4294-b67e-7849169bdd34', 'tenant_id': '6fe8110cd6254e09be7068976ea18ac4', 'mac_address': 'fa:16:3e:0a:61:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '37084be3-271f-42a7-9fd2-1ca8fd139b90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:03:19Z', 'updated_at': '2021-11-08T04:03:23Z', 'revision_number': 5, 'project_id': '6fe8110cd6254e09be7068976ea18ac4', 'subnets': [{'id': '4e98dd0f-b55a-4f27-ad1b-60c004f8751b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '54198234-8ef7-4782-85f9-e10b64ce8cd0'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:03:34.121333 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 96deb08e-345e-423e-96c2-9eccc5f3886d up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:03:34.205310 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 96deb08e-345e-423e-96c2-9eccc5f3886d triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:03:34.206080 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:34.303461 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:34.328789 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port 96deb08e-345e-423e-96c2-9eccc5f3886d, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=96deb08e-345e-423e-96c2-9eccc5f3886d,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:03:34.385439 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:34.440716 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=96deb08e-345e-423e-96c2-9eccc5f3886d,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:03:36.113650 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 96deb08e-345e-423e-96c2-9eccc5f3886d up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:03:36.203433 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 96deb08e-345e-423e-96c2-9eccc5f3886d triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:03:36.203829 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:42.670899 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-aeec4de4-437c-4f18-aa7e-2ef7cf645f05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:45.119053 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-80aeba31-d8f1-4730-b1d9-9b129ab50c77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:45.905120 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:47.539454 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:48.362932 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:03:57.981673 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 5 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:04:12.618457 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c55c8a99-6980-4b38-adfb-7af340d8e4e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:04:15.127152 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-58262cbd-449b-45e5-9c7b-ed6383918181 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:04:16.109884 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:04:17.481121 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:04:18.350300 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:04:34.981339 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 5 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:04:42.623168 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1c24c89e-6ccc-41db-b176-4a22d9fa3ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:04:45.132764 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-954fc699-61e8-4d3a-9c49-3eb5a8d20570 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:04:45.903619 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:04:47.508756 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:04:48.337125 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:11.980136 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 5 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:05:12.645207 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9a78d127-d722-4c17-bacc-f9218ee3cb9e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:15.130788 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3049a67b-f9c9-432e-8c53-644f5d5436ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:15.868499 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:16.874585 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48260) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:05:16.935262 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.pecan_wsgi.hooks.translation [None req-3434dbc7-ba28-463d-bc04-b501508d9a36 admin admin] GET failed (client error): The resource could not be found. Nov 08 04:05:16.936612 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-3434dbc7-ba28-463d-bc04-b501508d9a36 admin admin] 10.222.0.21 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0610719 Nov 08 04:05:17.095005 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43076d40-532b-4a2e-98fb-9e601cb68b57 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:17.096371 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-43076d40-532b-4a2e-98fb-9e601cb68b57 admin admin] 10.222.0.21 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1550524 Nov 08 04:05:17.507777 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:18.359399 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:19.372781 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48270) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:05:19.463814 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc17e0cc-ae79-4290-ba63-b6c081ba6956 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:19.465117 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-cc17e0cc-ae79-4290-ba63-b6c081ba6956 admin admin] 10.222.0.21 "GET /v2.0/subnets/4e98dd0f-b55a-4f27-ad1b-60c004f8751b HTTP/1.1" status: 200 len: 849 time: 0.0914059 Nov 08 04:05:19.474922 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:05:19.557093 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Publish callbacks [] for subnet, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:19.736712 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8785436140171'] for subnet, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:19.763711 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:19.764363 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:19.765606 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] 10.222.0.21 "PUT /v2.0/subnets/4e98dd0f-b55a-4f27-ad1b-60c004f8751b HTTP/1.1" status: 200 len: 868 time: 0.2942512 Nov 08 04:05:19.774275 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10c9c3f2-758d-4b68-833f-3cf364246eaa None None] Network 1007f26c-b619-4294-b67e-7849169bdd34 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:05:19.795371 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Pushing event updated for resources: {'Subnet': ['ID=4e98dd0f-b55a-4f27-ad1b-60c004f8751b,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:05:19.804609 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.804986 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.805312 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.805638 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.805962 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.806283 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.806640 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.806974 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.807384 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.807631 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.807942 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:19.808310 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88361a1a-df66-4c60-977e-e70927117f6e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:05:20.103180 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-bc3ce144-c057-4ced-919a-ce9e0e0f46af None None] Provisioning complete for port ebd2ff38-219c-4f1e-a96d-3c5d8702f2d8 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:05:20.103539 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bc3ce144-c057-4ced-919a-ce9e0e0f46af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:20.185388 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-bc3ce144-c057-4ced-919a-ce9e0e0f46af None None] Provisioning complete for port 21e234ce-c50d-4281-8e38-2cca18b6ee27 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:05:20.185747 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bc3ce144-c057-4ced-919a-ce9e0e0f46af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:22.056435 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48280) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:05:22.247548 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad09f1e9-0fd6-437b-af62-564426ce0d30 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:22.247926 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad09f1e9-0fd6-437b-af62-564426ce0d30 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:22.249420 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ad09f1e9-0fd6-437b-af62-564426ce0d30 admin admin] 10.222.0.21 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1920166 Nov 08 04:05:24.514948 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48288) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:05:24.709441 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e75ab7bf-45b2-40df-9f82-c8bda770a4d6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:24.709837 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e75ab7bf-45b2-40df-9f82-c8bda770a4d6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:24.711392 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e75ab7bf-45b2-40df-9f82-c8bda770a4d6 admin admin] 10.222.0.21 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1955116 Nov 08 04:05:26.988793 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48296) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:05:27.117755 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e66169f6-2e3d-4207-b1c9-bc4f8ca2842a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:27.121137 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-e66169f6-2e3d-4207-b1c9-bc4f8ca2842a admin admin] 10.222.0.21 "GET /v2.0/networks/1007f26c-b619-4294-b67e-7849169bdd34 HTTP/1.1" status: 200 len: 869 time: 0.1293986 Nov 08 04:05:29.389306 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48304) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:05:29.508731 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d7eae67-66c8-48fb-be5d-52cf9c8b7ab2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:29.510072 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-2d7eae67-66c8-48fb-be5d-52cf9c8b7ab2 admin admin] 10.222.0.21 "GET /v2.0/networks/5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 HTTP/1.1" status: 200 len: 886 time: 0.1198468 Nov 08 04:05:31.781577 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48312) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:05:31.977869 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-178f60c8-0f6c-4ab7-a66a-68f4a0909c98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:31.978228 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-178f60c8-0f6c-4ab7-a66a-68f4a0909c98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:31.979784 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-178f60c8-0f6c-4ab7-a66a-68f4a0909c98 admin admin] 10.222.0.21 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1972692 Nov 08 04:05:34.272521 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48320) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:05:34.437886 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6f75b7f-25b9-4118-bddb-30b1e26a2c47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:34.438252 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6f75b7f-25b9-4118-bddb-30b1e26a2c47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:34.439797 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f6f75b7f-25b9-4118-bddb-30b1e26a2c47 admin admin] 10.222.0.21 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1663427 Nov 08 04:05:36.698715 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48328) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:05:36.789236 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73c877b9-955d-48b1-8ddb-1087b0753a31 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:36.790587 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-73c877b9-955d-48b1-8ddb-1087b0753a31 admin admin] 10.222.0.21 "GET /v2.0/subnets/4e98dd0f-b55a-4f27-ad1b-60c004f8751b HTTP/1.1" status: 200 len: 868 time: 0.0909019 Nov 08 04:05:39.059080 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48336) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:05:39.142340 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f437ad1-f03c-4318-8abd-a3834c331a45 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:05:39.143682 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-3f437ad1-f03c-4318-8abd-a3834c331a45 admin admin] 10.222.0.21 "GET /v2.0/subnets/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9 HTTP/1.1" status: 200 len: 816 time: 0.0836720 Nov 08 04:05:42.661529 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-151cfab2-3deb-40d7-9f7c-938e52aef978 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:45.153070 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a94ddde0-b7e5-4b46-a531-5bd76961e8f8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:45.884668 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:47.513213 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:48.375916 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:05:48.977777 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 5 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:06:03.568318 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48390) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:06:03.616489 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [None req-c7040fd0-5604-4c10-9d1a-8324d3233a6a admin admin] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:06:03.617470 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-c7040fd0-5604-4c10-9d1a-8324d3233a6a admin admin] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0481613 Nov 08 04:06:05.990407 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48398) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:06:06.052275 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.pecan_wsgi.hooks.translation [None req-abf74362-9cf5-411a-b541-2690d7267700 admin admin] GET failed (client error): The resource could not be found. Nov 08 04:06:06.053569 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-abf74362-9cf5-411a-b541-2690d7267700 admin admin] 10.222.0.21 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0622075 Nov 08 04:06:06.190303 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-207976d3-5272-4884-b091-2a4b40ff594a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:06:06.191685 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-207976d3-5272-4884-b091-2a4b40ff594a admin admin] 10.222.0.21 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1335931 Nov 08 04:06:08.515235 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48406) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:06:08.560970 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:06:08.649669 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Made reservation on behalf of d4153515b8704248acfc9ad6fd8dd2fc for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:06:08.652158 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:08.678759 dv-cinder-783643-4-iscsi neutron-server[101665]: WARNING neutron.services.revisions.revision_plugin [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Could not find related network for resource to bump revision. Nov 08 04:06:08.697862 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] vlan segment allocate from pool success with {'vlan_id': 164, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:06:08.705762 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8785436166440', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:08.706289 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Unsubscribe: segment precommit_create {{(pid=101665) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 08 04:06:08.706788 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Added segment cc10be93-0a6f-4015-8f02-6e9e8ff3abed of type vlan for network 18db37fe-c823-44c7-b9ff-932f31016ab2 Nov 08 04:06:08.765825 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:08.849002 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:08.850112 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:06:08.850805 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:08.936112 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] Pushing event updated for resources: {'Network': ['ID=18db37fe-c823-44c7-b9ff-932f31016ab2,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:06:08.946219 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 18db37fe-c823-44c7-b9ff-932f31016ab2 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:06:08.966814 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ca3d2cff-9b32-4306-97bb-6879b64bf50e admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4504156 Nov 08 04:06:11.285450 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48414) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:06:11.344644 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.pecan_wsgi.hooks.translation [None req-23a48f82-f547-4c71-ad48-f1b99e5b753b admin admin] GET failed (client error): The resource could not be found. Nov 08 04:06:11.346422 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-23a48f82-f547-4c71-ad48-f1b99e5b753b admin admin] 10.222.0.21 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0600131 Nov 08 04:06:11.415205 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f2399cf-3f55-4536-8e79-8a32f5e2d9a4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:06:11.416601 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-7f2399cf-3f55-4536-8e79-8a32f5e2d9a4 admin admin] 10.222.0.21 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0655158 Nov 08 04:06:11.427429 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'description': 'shared-subnet', 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2', 'ip_version': 4, 'name': 'shared-subnet'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:06:11.540646 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Made reservation on behalf of d4153515b8704248acfc9ad6fd8dd2fc for: {'subnet': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:06:11.542913 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Publish callbacks [] for subnet, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:11.763835 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:11.815766 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Pushing event updated for resources: {'Subnet': ['ID=b3499532-a30e-4b90-986b-3792010a47fb,revision_number=0']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:06:11.826100 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Checking segment: {'id': 'cc10be93-0a6f-4015-8f02-6e9e8ff3abed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:06:11.826446 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Network hostable DHCP agents. Network: 18db37fe-c823-44c7-b9ff-932f31016ab2, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101665) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:06:11.889127 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Network 18db37fe-c823-44c7-b9ff-932f31016ab2 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101665) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:06:11.957967 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 18db37fe-c823-44c7-b9ff-932f31016ab2) {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:06:11.962425 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:06:11.963442 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:11.966651 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86d6238c-2820-4a93-b961-183efd85eeda None None] Network 18db37fe-c823-44c7-b9ff-932f31016ab2 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:06:12.054518 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-2139ed18-f8f7-4b84-b42e-88f96738797e admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6116199 Nov 08 04:06:12.208870 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp69aa137b-4136-5a6b-bf5e-deeb8c067c65-18db37fe-c823-44c7-b9ff-932f31016ab2', 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2', 'tenant_id': 'd4153515b8704248acfc9ad6fd8dd2fc', 'fixed_ips': [{'subnet_id': 'b3499532-a30e-4b90-986b-3792010a47fb'}]}} from dv-cinder-783643-4-iscsi. {{(pid=101666) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 04:06:12.209767 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:12.341920 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.db_base_plugin_common [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Allocated IP 192.168.233.2 (18db37fe-c823-44c7-b9ff-932f31016ab2/b3499532-a30e-4b90-986b-3792010a47fb/e029251a-dfd3-4969-9008-494547fdb78b) {{(pid=101666) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:06:12.482720 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Publish callbacks [] for port, precommit_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:12.553209 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:12.613994 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Network 18db37fe-c823-44c7-b9ff-932f31016ab2 is already hosted by enough agents. {{(pid=101666) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:06:12.614832 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Pushing event updated for resources: {'Port': ['ID=e029251a-dfd3-4969-9008-494547fdb78b,revision_number=1']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:06:12.620358 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.base_scheduler [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Resources bound (agent type, host, resource id): {{(pid=101666) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:06:12.626275 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Received port after_create {{(pid=101666) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:06:12.630462 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.630848 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.631189 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.631526 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.631851 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.632174 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.632513 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.632816 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.633155 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.633477 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.635682 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.635682 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:06:12.685961 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Attempting to bind port e029251a-dfd3-4969-9008-494547fdb78b on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:06:12.686320 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Attempting to bind port e029251a-dfd3-4969-9008-494547fdb78b by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': 'cc10be93-0a6f-4015-8f02-6e9e8ff3abed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:06:12.686802 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Attempting to bind port e029251a-dfd3-4969-9008-494547fdb78b on network 18db37fe-c823-44c7-b9ff-932f31016ab2 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:06:12.692299 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 5, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:06:12.692651 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Checking segment: {'id': 'cc10be93-0a6f-4015-8f02-6e9e8ff3abed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:06:12.693035 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:12.693423 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Bound using segment: {'id': 'cc10be93-0a6f-4015-8f02-6e9e8ff3abed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:06:12.693871 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Bound port: e029251a-dfd3-4969-9008-494547fdb78b, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cc10be93-0a6f-4015-8f02-6e9e8ff3abed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:06:12.694350 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:12.708112 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c83ad1cb-33bf-4566-810f-b51ad88f6d8e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:12.756874 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] For port e029251a-dfd3-4969-9008-494547fdb78b, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:06:12.759778 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] For port e029251a-dfd3-4969-9008-494547fdb78b, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=e029251a-dfd3-4969-9008-494547fdb78b,segment=NetworkSegment(cc10be93-0a6f-4015-8f02-6e9e8ff3abed),segment_id=cc10be93-0a6f-4015-8f02-6e9e8ff3abed)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:06:12.838804 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:12.899353 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c4c35b-d651-46a4-bd45-3253e99d3c2f None None] Pushing event updated for resources: {'Port': ['ID=e029251a-dfd3-4969-9008-494547fdb78b,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:06:13.698727 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-583d1357-880e-4560-ba54-f4b5c35e8261 None None] Network 18db37fe-c823-44c7-b9ff-932f31016ab2 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:06:13.810281 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-d6a2b7d3-19d7-454c-a3dc-db500a55ed99 None None] Provisioning complete for port e029251a-dfd3-4969-9008-494547fdb78b triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:06:13.810681 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d6a2b7d3-19d7-454c-a3dc-db500a55ed99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:13.926801 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d6a2b7d3-19d7-454c-a3dc-db500a55ed99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:13.965736 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-d6a2b7d3-19d7-454c-a3dc-db500a55ed99 None None] For port e029251a-dfd3-4969-9008-494547fdb78b, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=e029251a-dfd3-4969-9008-494547fdb78b,segment=NetworkSegment(cc10be93-0a6f-4015-8f02-6e9e8ff3abed),segment_id=cc10be93-0a6f-4015-8f02-6e9e8ff3abed)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:06:14.055263 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d6a2b7d3-19d7-454c-a3dc-db500a55ed99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:14.102341 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6a2b7d3-19d7-454c-a3dc-db500a55ed99 None None] Pushing event updated for resources: {'Port': ['ID=e029251a-dfd3-4969-9008-494547fdb78b,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:06:14.176384 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-17ab3314-9e88-4266-a9cd-7828dc3b4d37 None None] Provisioning complete for port e029251a-dfd3-4969-9008-494547fdb78b triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:06:14.176863 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-17ab3314-9e88-4266-a9cd-7828dc3b4d37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:14.204858 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device e029251a-dfd3-4969-9008-494547fdb78b up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:06:14.288151 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port e029251a-dfd3-4969-9008-494547fdb78b triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:06:14.314702 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:15.152595 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-970c1bf9-4b15-44d6-a215-4b5e5e89b6b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:15.900917 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:17.535267 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:18.352371 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:25.976913 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 5 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:06:42.642710 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-4052855e-908a-43de-817f-84d489f38446 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:45.111526 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7fe430e8-972e-455b-a363-ebd7869a2e29 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:45.877191 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:47.528210 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:06:48.391616 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:02.976442 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 5 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:07:12.647168 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b0a0f686-e29f-418c-9b60-0a6077757260 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:15.120874 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b96b33c1-1888-43f4-9a35-928b1165d79a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:15.922217 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:17.516459 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:18.339299 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:39.975462 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 5 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:07:42.646211 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-35d05e86-94fd-4ed7-af44-f794d13039d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:45.172356 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7425ba69-4fcd-413c-bd12-195491c66ea6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:45.926737 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:47.538201 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:48.354278 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:53.186808 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48460) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:07:53.192514 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [None req-3edfb122-ce18-4f88-817a-d52298adb2bc tempest-verify_tempest_config-1239842307 tempest-verify_tempest_config-1239842307-project] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:07:53.193535 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-3edfb122-ce18-4f88-817a-d52298adb2bc tempest-verify_tempest_config-1239842307 tempest-verify_tempest_config-1239842307-project] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0056753 Nov 08 04:07:53.825336 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48478) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:07:53.924985 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:54.001758 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:54.097898 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:54.143419 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=c641dd102c8e4cfcbc3a52c51cf05819&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3169670 Nov 08 04:07:54.144081 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8d1979a-829d-45a6-8523-e05885209f52,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:07:54.146078 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48484) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:07:54.150710 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.151056 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.151393 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.151725 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.152053 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.152395 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.152725 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.153130 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.153472 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.153795 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.154195 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.154541 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48d47977-a099-48ea-99a2-dc9a3f8923b4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.219171 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:54.242134 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:54.407058 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:54.409467 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:07:54.410624 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/d8d1979a-829d-45a6-8523-e05885209f52 HTTP/1.1" status: 204 len: 168 time: 0.2635465 Nov 08 04:07:54.419054 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8d1979a-829d-45a6-8523-e05885209f52,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:07:54.426317 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.426692 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.427031 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.427358 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.427685 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.428100 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.428694 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.429274 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.429274 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.429473 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.429795 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:07:54.430091 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48788f3-152d-4e98-8dd8-d3b99ea8466d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:08:12.673103 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b2276f19-7333-4823-804a-861d089c3f6a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:08:15.114558 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-179882c6-accc-4bad-a4ad-d4f6634f03ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:08:15.914531 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:08:16.976387 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 5 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:08:17.525609 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:08:18.371622 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:08:42.632376 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-6e9f7348-5d02-494d-a835-c78d80d10a5e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:08:45.152086 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b8c2b03-71ba-43cf-a57c-e07ef18076c9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:08:45.890936 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:08:47.542198 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:08:48.369001 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:08:53.975153 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 5 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:09:12.659920 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bd6c85d5-df47-4ab4-a840-861669bce5db None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:15.156492 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-23cb4061-1850-4369-8fdd-3e7aff89d1a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:15.935932 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:17.539506 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:18.352600 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:24.167710 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-703218'] for agent, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:30.973455 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:09:39.147779 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48556) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:09:39.254271 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-91dd2c50-cbc6-4a01-82b8-5ba60ed6f5cc admin admin] 10.222.0.21 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1053851 Nov 08 04:09:41.594631 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48566) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:09:41.648095 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-203d8e42-0edf-4d51-9f01-27e85c463730 admin admin] 10.222.0.21 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0524051 Nov 08 04:09:42.632309 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-22a0cc80-ab19-43c8-9c87-5c805bf9d2ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:45.157780 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-4600f2f9-2457-4e9c-a8c5-5f0a3137c33d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:45.912379 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:47.544432 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:48.355865 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:09:54.126782 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:07.973040 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:10:12.636530 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-4de64067-b99e-458c-8770-7b6e751977de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:15.128155 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-db10306d-55ee-49d7-98b9-cbb25128ca93 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:15.911230 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:17.554404 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:18.367882 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:24.133426 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:42.647762 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-0a10c5dd-932d-4939-a444-ca40ebdd8b51 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:44.971229 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:10:45.173467 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-717c8c43-0262-44cb-aacf-8da14fc85ad9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:46.031578 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:47.544962 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:48.361636 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:10:54.132999 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:12.635304 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-45e94af2-aab2-4d8d-bb18-9dbc5aae1b70 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:13.785246 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48762) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:14.475948 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48784) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:14.480144 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-793172912-network', 'tenant_id': '10aa52c671b04a70bee6132d644fcea6'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:14.510375 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48790) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:14.544233 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48794) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:14.578227 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Made reservation on behalf of 10aa52c671b04a70bee6132d644fcea6 for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:14.583500 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.591427 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.656055 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48802) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:14.678229 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.711245 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-network', 'tenant_id': '0efb8c7b359746668b199d14191e3f09'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:14.743016 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1483896956-network', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:14.752608 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.768669 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] vlan segment allocate from pool success with {'vlan_id': 152, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:11:14.788117 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-network', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:14.796245 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.796933 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Added segment 40c10b14-9bad-4182-9d99-8cce48b6c4f8 of type vlan for network 73a3dfba-be87-4070-93d2-b14149196c8c Nov 08 04:11:14.841208 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Made reservation on behalf of 0efb8c7b359746668b199d14191e3f09 for: {'network': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:14.842276 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.844023 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.857425 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.888304 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.db.api [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 08 04:11:14.888304 dv-cinder-783643-4-iscsi neutron-server[101665]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 08 04:11:14.888304 dv-cinder-783643-4-iscsi neutron-server[101665]: [parameters: {'project_id_1': 'e9678ed98e7944babc4f6af7fb368440', 'expiration_1': datetime.datetime(2021, 11, 8, 4, 10, 54, 877454)}] Nov 08 04:11:14.888304 dv-cinder-783643-4-iscsi neutron-server[101665]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=101665) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 08 04:11:14.889416 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG oslo_db.api [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 08 04:11:14.892744 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36102ae7-0ddc-41f4-9315-3e2df4d2d253,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:14.904078 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.908590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Tracked resource versions report: Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: pushed versions: Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: { 'AddressGroup': {'1.2'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'ConntrackHelper': {'1.0'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Log': {'1.0'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Network': {'1.1'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Port': {'1.7'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'PortForwarding': {'1.2'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'QosPolicy': {'1.10'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SecurityGroup': {'1.5'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SecurityGroupRule': {'1.2'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SubPort': {'1.0'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Subnet': {'1.1'}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Trunk': {'1.1'}} Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: consumer versions: Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: { DHCP agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: HyperV agent@hv-cinder-78364: {}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: L3 agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: Metadata agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: Metering agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: Open vSwitch agent@dv-cinder-783643-4-iscsi: { 'AddressGroup': '1.2', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'ConntrackHelper': '1.0', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Log': '1.0', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Network': '1.1', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Port': '1.7', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'PortForwarding': '1.2', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'QosPolicy': '1.10', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SecurityGroup': '1.5', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SecurityGroupRule': '1.2', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'SubPort': '1.0', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Subnet': '1.1', Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: 'Trunk': '1.1'}} Nov 08 04:11:14.910507 dv-cinder-783643-4-iscsi neutron-server[101665]: {{(pid=101665) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 04:11:14.926565 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.927807 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:14.928572 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.964598 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:14.991897 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Made reservation on behalf of ebd67f9cc3964c7bbc45974e8833edd2 for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:14.994175 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.002082 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-908773995-network', 'tenant_id': 'f3ecedce4bce4764a6bd2e0cc60c4955'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:15.006813 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.018270 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] Pushing event updated for resources: {'Network': ['ID=73a3dfba-be87-4070-93d2-b14149196c8c,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:15.029384 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.030782 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 73a3dfba-be87-4070-93d2-b14149196c8c details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:11:15.054084 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-5121ca40-1a63-4e75-a8a6-9c7d687b673b admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.2676985 Nov 08 04:11:15.058465 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48820) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:15.063361 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Request body: {'subnet': {'network_id': '73a3dfba-be87-4070-93d2-b14149196c8c', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-793172912-subnet', 'tenant_id': '10aa52c671b04a70bee6132d644fcea6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:15.088192 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a7a9d09-4e67-4c3c-b165-219721505500,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:15.099363 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.100236 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.101057 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.101929 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.102461 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.103334 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.106244 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.106244 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.106244 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.106244 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.107409 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.107944 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Tracked resource versions report: Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: pushed versions: Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: { 'AddressGroup': {'1.2'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'ConntrackHelper': {'1.0'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Log': {'1.0'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Network': {'1.1'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Port': {'1.7'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'PortForwarding': {'1.2'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'QosPolicy': {'1.10'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SecurityGroup': {'1.5'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SecurityGroupRule': {'1.2'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SubPort': {'1.0'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Subnet': {'1.1'}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Trunk': {'1.1'}} Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: consumer versions: Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: { DHCP agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: HyperV agent@hv-cinder-78364: {}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: L3 agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: Metadata agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: Metering agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: Open vSwitch agent@dv-cinder-783643-4-iscsi: { 'AddressGroup': '1.2', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'ConntrackHelper': '1.0', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Log': '1.0', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Network': '1.1', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Port': '1.7', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'PortForwarding': '1.2', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'QosPolicy': '1.10', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SecurityGroup': '1.5', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SecurityGroupRule': '1.2', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'SubPort': '1.0', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Subnet': '1.1', Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: 'Trunk': '1.1'}} Nov 08 04:11:15.109153 dv-cinder-783643-4-iscsi neutron-server[101664]: {{(pid=101664) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 04:11:15.121216 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] vlan segment allocate from pool success with {'vlan_id': 184, 'physical_network': 'physnet1'} {{(pid=101664) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:11:15.121818 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.131765 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.133147 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.segments_db [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Added segment c233b592-8fd7-4c2a-b811-110d9b226d31 of type vlan for network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e Nov 08 04:11:15.171109 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Made reservation on behalf of f3ecedce4bce4764a6bd2e0cc60c4955 for: {'network': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:15.173963 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.188592 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.207302 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.212874 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.241038 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7201c229-3323-4bf9-bd6b-b127dd44ae1e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.254978 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] vlan segment allocate from pool success with {'vlan_id': 161, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:11:15.257030 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Made reservation on behalf of 10aa52c671b04a70bee6132d644fcea6 for: {'subnet': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:15.259325 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.280796 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.290810 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.291159 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Added segment c986aa14-0950-49b8-b946-4f7a7bf09171 of type vlan for network bd0479b2-da8e-41bd-929c-b9ece4aaa29f Nov 08 04:11:15.292992 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af334b91-f329-4196-9d62-2a02e59082c1,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:15.341329 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.371226 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.383550 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] vlan segment allocate from pool success with {'vlan_id': 167, 'physical_network': 'physnet1'} {{(pid=101664) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:11:15.401742 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.408825 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:15.409802 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.436207 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.436656 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.segments_db [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Added segment 6af2a9a8-7c62-4511-940f-bdb70a610241 of type vlan for network 1516eeae-19de-448e-9ebd-952b54f99dcc Nov 08 04:11:15.495131 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:15.515546 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.531600 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.540533 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:15.540533 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.587364 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] Pushing event updated for resources: {'Network': ['ID=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:15.614137 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:11:15.649982 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.651539 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:15.652141 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.689640 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-2341753c-7936-4330-a505-4990bce68791 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.2093270 Nov 08 04:11:15.689877 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48840) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:15.694608 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Request body: {'subnet': {'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-subnet', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:15.715711 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Made reservation on behalf of e9678ed98e7944babc4f6af7fb368440 for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:15.717948 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.730983 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] Pushing event updated for resources: {'Network': ['ID=1516eeae-19de-448e-9ebd-952b54f99dcc,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:15.746748 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 1516eeae-19de-448e-9ebd-952b54f99dcc details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:11:15.752688 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.761490 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-548f7483-6768-4081-90b7-82244b188e4b admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.1047926 Nov 08 04:11:15.764413 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48844) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:15.767444 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] Pushing event updated for resources: {'Network': ['ID=bd0479b2-da8e-41bd-929c-b9ece4aaa29f,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:15.770036 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Request body: {'subnet': {'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-908773995-subnet', 'tenant_id': 'f3ecedce4bce4764a6bd2e0cc60c4955', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:15.787143 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network bd0479b2-da8e-41bd-929c-b9ece4aaa29f details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:11:15.829793 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-cb45177d-1fc3-4771-ac6c-50b887bbb218 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.3154066 Nov 08 04:11:15.829793 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.831774 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48846) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:15.842865 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Request body: {'subnet': {'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1483896956-subnet', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:15.889589 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.909570 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Made reservation on behalf of 0efb8c7b359746668b199d14191e3f09 for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:15.912726 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:15.921494 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e73cdb7b-96cb-4d2a-bf8a-e10140c5dc14,revision_number=0']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:15.924789 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Checking segment: {'id': '40c10b14-9bad-4182-9d99-8cce48b6c4f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '73a3dfba-be87-4070-93d2-b14149196c8c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:15.925139 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Network hostable DHCP agents. Network: 73a3dfba-be87-4070-93d2-b14149196c8c, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101665) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:11:16.006647 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.036535 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] vlan segment allocate from pool success with {'vlan_id': 170, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:11:16.046004 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62a05974-7d67-4e01-81d5-ecfb972cef00,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:16.051617 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.051961 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Added segment 8f7e22fd-7d1a-479e-9785-43712201ed49 of type vlan for network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 Nov 08 04:11:16.069524 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.076787 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Made reservation on behalf of f3ecedce4bce4764a6bd2e0cc60c4955 for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:16.079895 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Publish callbacks [] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.089868 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Network 73a3dfba-be87-4070-93d2-b14149196c8c is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101665) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:11:16.105790 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.159988 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.263177 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Pushing event updated for resources: {'Subnet': ['ID=20a91346-16ed-4174-9e29-b85a8dc77939,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:16.314409 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Checking segment: {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:16.324611 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Network hostable DHCP agents. Network: 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:11:16.344126 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 73a3dfba-be87-4070-93d2-b14149196c8c) {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:16.345672 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Made reservation on behalf of ebd67f9cc3964c7bbc45974e8833edd2 for: {'subnet': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:16.347990 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Publish callbacks [] for subnet, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.352234 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e842267-041d-4aa9-803b-1827a4d84843 None None] Network 73a3dfba-be87-4070-93d2-b14149196c8c requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:11:16.356705 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:16.356705 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.426731 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.426731 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:16.426731 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.444345 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.497053 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:11:16.520510 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e65c9bad-2733-4645-ba1b-c9704c8f7bed None None] Network 73a3dfba-be87-4070-93d2-b14149196c8c requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:11:16.523125 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:16.524494 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-3edb2d37-b52a-45c2-b9e0-e5109f2ab3c9 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.4649122 Nov 08 04:11:16.546335 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:16.547308 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.555604 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60951777-0a87-4f27-aa99-2c87d4566124 None None] Network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:11:16.573330 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Pushing event updated for resources: {'Subnet': ['ID=59ccbcae-2516-4cc7-9077-478845e3e1f2,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:16.609477 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Checking segment: {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:16.610571 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Network hostable DHCP agents. Network: 1516eeae-19de-448e-9ebd-952b54f99dcc, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:11:16.664808 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] Pushing event updated for resources: {'Network': ['ID=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:16.686882 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:11:16.710750 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e3ed9b33-607e-49c9-889a-83f4636ed769 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 1.0195651 Nov 08 04:11:16.712165 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Network 1516eeae-19de-448e-9ebd-952b54f99dcc is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:11:16.712350 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-93206209-ca2f-4b3c-a7a8-aa26f42f8192 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 2.1667271 Nov 08 04:11:16.717575 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48876) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:16.718171 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48878) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:16.733411 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Request body: {'subnet': {'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-subnet', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:16.784671 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:16.886335 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Made reservation on behalf of e9678ed98e7944babc4f6af7fb368440 for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:16.893157 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Publish callbacks [] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:16.939242 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 1516eeae-19de-448e-9ebd-952b54f99dcc) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:16.954526 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28b44da6-2465-46e0-9958-dd512caf8d29 None None] Network 1516eeae-19de-448e-9ebd-952b54f99dcc requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:11:16.960970 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.030799 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp69aa137b-4136-5a6b-bf5e-deeb8c067c65-6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939'}]}} from dv-cinder-783643-4-iscsi. {{(pid=101666) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 04:11:17.030799 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.072965 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Checking segment: {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:17.073349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Network hostable DHCP agents. Network: bd0479b2-da8e-41bd-929c-b9ece4aaa29f, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101665) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:11:17.116110 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Pushing event updated for resources: {'Subnet': ['ID=1158e941-c129-49d0-9b8b-ba72d0ef6717,revision_number=0']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:17.168914 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-701463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7538'] for router, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.169989 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-701603', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-688686', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-770197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7531'] for router, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.174920 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:17.175513 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.181803 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Network bd0479b2-da8e-41bd-929c-b9ece4aaa29f is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101665) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:11:17.201482 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48916) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:17.205020 dv-cinder-783643-4-iscsi neutron-server[101665]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 08 04:11:17.258684 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.261200 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.269779 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fce494a-3fdd-4c96-ac20-70331e78cb5a None None] Network 1516eeae-19de-448e-9ebd-952b54f99dcc requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:11:17.277284 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.db_base_plugin_common [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Allocated IP 172.20.0.2 (6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e/20a91346-16ed-4174-9e29-b85a8dc77939/495ffdd1-ff2f-4300-b636-fa1fcc35977b) {{(pid=101666) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:17.314935 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e4b21bd7-502f-48fd-9de8-eae98915809c admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.5492127 Nov 08 04:11:17.320773 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Pushing event updated for resources: {'Subnet': ['ID=900a12a5-1baa-47e1-8b64-245dc70bc9f2,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:17.323445 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, bd0479b2-da8e-41bd-929c-b9ece4aaa29f) {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:17.336192 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Checking segment: {'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:17.336752 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Network hostable DHCP agents. Network: 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:11:17.457464 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70e8eb84-5ff5-49ab-8bcd-63016874d6df None None] Network bd0479b2-da8e-41bd-929c-b9ece4aaa29f requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:11:17.514767 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:17.516153 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.568997 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.579904 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-09d54aba-5bf3-445d-8371-cd50eb815720 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:17.586876 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-09d54aba-5bf3-445d-8371-cd50eb815720 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/networks?id=73a3dfba-be87-4070-93d2-b14149196c8c HTTP/1.1" status: 200 len: 811 time: 0.3837032 Nov 08 04:11:17.607554 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-e03bcec0-f47e-4ac6-901a-df3df96f604f tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/quotas/10aa52c671b04a70bee6132d644fcea6 HTTP/1.1" status: 200 len: 375 time: 0.0198114 Nov 08 04:11:17.652072 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-3b80e0b0-c96b-47cd-9688-6da312db0abc admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.8176603 Nov 08 04:11:17.654987 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48932) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:17.659218 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:17.666111 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:11:17.670535 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-95217f02-8390-4f3f-a11d-92bb70ce0db3 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=10aa52c671b04a70bee6132d644fcea6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0546143 Nov 08 04:11:17.700133 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:17.709163 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:17.709745 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.742069 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 48950) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:17.755981 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82469ba5-c23f-4608-90a4-0c476505aaa3 None None] Network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:11:17.837373 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp69aa137b-4136-5a6b-bf5e-deeb8c067c65-bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717'}]}} from dv-cinder-783643-4-iscsi. {{(pid=101666) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 04:11:17.837927 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-701463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7538'] for router, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.838927 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.839053 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-701603', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-688686', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-770197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7531'] for router, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.871974 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-fa5ca39d-2fea-4cbd-8fbc-625c0a23bd56 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:17.873839 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-fa5ca39d-2fea-4cbd-8fbc-625c0a23bd56 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/networks?id=1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 200 len: 814 time: 0.1305559 Nov 08 04:11:17.896775 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-66f633c4-beaf-48ea-a1f8-f3b26b87b0e6 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/quotas/f3ecedce4bce4764a6bd2e0cc60c4955 HTTP/1.1" status: 200 len: 375 time: 0.0157237 Nov 08 04:11:17.900161 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.931778 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-bcbb3105-6d26-489d-9c4b-3ffcc4880851 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0315421 Nov 08 04:11:17.936041 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-69de784f-38dd-4efe-816c-14889cf273f4 service neutron] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:11:17.937475 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-69de784f-38dd-4efe-816c-14889cf273f4 service neutron] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0626180 Nov 08 04:11:17.966452 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-4754deab-56db-48cb-980a-aa79562f251a admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 1.2442031 Nov 08 04:11:17.968707 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 48960) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:17.972002 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Publish callbacks [] for port, precommit_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:17.977120 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-router', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:18.070650 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-51ed2a04-6d66-451d-89a2-174d003398c1 service neutron] 10.222.0.21 "GET /v2.0/networks/73a3dfba-be87-4070-93d2-b14149196c8c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1256981 Nov 08 04:11:18.082716 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.095747 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.099860 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.125620 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.132289 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-d67e250a-1e87-4e9e-8434-86cadedcb250 service neutron] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:11:18.139418 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-d67e250a-1e87-4e9e-8434-86cadedcb250 service neutron] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1185174 Nov 08 04:11:18.176850 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e is already hosted by enough agents. {{(pid=101666) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:18.183744 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-701463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7538'] for router, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.184741 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-701603', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-688686', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-770197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7531'] for router, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.200668 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.base_scheduler [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Resources bound (agent type, host, resource id): {{(pid=101666) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:18.200668 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Received port after_create {{(pid=101666) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:18.228303 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.db_base_plugin_common [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Allocated IP 172.20.0.2 (bd0479b2-da8e-41bd-929c-b9ece4aaa29f/1158e941-c129-49d0-9b8b-ba72d0ef6717/be0ad184-b6ed-4693-96f3-e5167761a498) {{(pid=101666) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:18.231310 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Pushing event updated for resources: {'Port': ['ID=495ffdd1-ff2f-4300-b636-fa1fcc35977b,revision_number=1']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:18.243020 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-08e864ce-8581-4241-89a0-8a69cef88d3a service neutron] 10.222.0.21 "GET /v2.0/networks/73a3dfba-be87-4070-93d2-b14149196c8c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1706576 Nov 08 04:11:18.246255 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-240d1db2-be8c-470e-86e4-9a46e1cf3648 None None] Network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:11:18.257404 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.257734 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.258074 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.258408 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.258774 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.259162 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.259821 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.260156 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.260517 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.260843 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.261161 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.261477 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Tracked resource versions report: Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: pushed versions: Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: { 'AddressGroup': {'1.2'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'ConntrackHelper': {'1.0'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Log': {'1.0'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Network': {'1.1'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Port': {'1.7'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'PortForwarding': {'1.2'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'QosPolicy': {'1.10'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SecurityGroup': {'1.5'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SecurityGroupRule': {'1.2'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SubPort': {'1.0'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Subnet': {'1.1'}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Trunk': {'1.1'}} Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: consumer versions: Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: { DHCP agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: HyperV agent@hv-cinder-78364: {}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: L3 agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: Metadata agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: Metering agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: Open vSwitch agent@dv-cinder-783643-4-iscsi: { 'AddressGroup': '1.2', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'ConntrackHelper': '1.0', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Log': '1.0', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Network': '1.1', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Port': '1.7', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'PortForwarding': '1.2', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'QosPolicy': '1.10', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SecurityGroup': '1.5', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SecurityGroupRule': '1.2', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'SubPort': '1.0', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Subnet': '1.1', Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: 'Trunk': '1.1'}} Nov 08 04:11:18.262547 dv-cinder-783643-4-iscsi neutron-server[101666]: {{(pid=101666) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 04:11:18.275744 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-b2cb6022-b55d-4519-abef-c2afa02ef935 service neutron] 10.222.0.21 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1354470 Nov 08 04:11:18.407880 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-4fb0e66c-d335-48b9-a80b-ed856c8e0cb5 service neutron] 10.222.0.21 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1258013 Nov 08 04:11:18.451945 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.455437 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.491987 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Allocated IP 172.27.2.133 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/0789f50b-915f-4c46-85b3-aa1902eb4af4) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:18.512536 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Attempting to bind port 495ffdd1-ff2f-4300-b636-fa1fcc35977b on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:18.513003 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Attempting to bind port 495ffdd1-ff2f-4300-b636-fa1fcc35977b by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:18.513342 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Attempting to bind port 495ffdd1-ff2f-4300-b636-fa1fcc35977b on network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:18.520934 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:18.521389 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Checking segment: {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:18.521686 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.522169 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Bound using segment: {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:18.522594 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Bound port: 495ffdd1-ff2f-4300-b636-fa1fcc35977b, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:18.523009 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.619794 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.708313 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] For port 495ffdd1-ff2f-4300-b636-fa1fcc35977b, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:18.715384 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] For port 495ffdd1-ff2f-4300-b636-fa1fcc35977b, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=495ffdd1-ff2f-4300-b636-fa1fcc35977b,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:18.775656 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1fd18c23-d5bc-42d3-a3e7-16638405f8a2 req-6ae3203d-84f4-4236-b937-390f2ce39cd8 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 210 time: 0.1169178 Nov 08 04:11:18.810960 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.824339 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.875055 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Publish callbacks [] for port, precommit_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.881968 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:18.981107 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b47b5ad7-adda-4e37-a5ad-2340862900b4 None None] Pushing event updated for resources: {'Port': ['ID=495ffdd1-ff2f-4300-b636-fa1fcc35977b,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:19.042137 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:19.137797 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91e2bbd9-99ed-4ceb-a2c8-a928add4aba0 req-2c3d7c5f-02fd-4ab2-87eb-b0c9bafad57e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.0745485 Nov 08 04:11:19.204746 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:19.213501 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Network bd0479b2-da8e-41bd-929c-b9ece4aaa29f is already hosted by enough agents. {{(pid=101666) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:19.213501 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.base_scheduler [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Resources bound (agent type, host, resource id): {{(pid=101666) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:19.219995 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Received port after_create {{(pid=101666) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:19.225621 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:19.226908 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Pushing event updated for resources: {'Port': ['ID=be0ad184-b6ed-4693-96f3-e5167761a498,revision_number=1']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:19.413521 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Allocated IP 172.27.2.101 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/2d9dbcc2-e0b8-432f-805e-9d60c35596e4) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:19.413521 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:19.449041 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Attempting to bind port be0ad184-b6ed-4693-96f3-e5167761a498 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:19.449041 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Attempting to bind port be0ad184-b6ed-4693-96f3-e5167761a498 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:19.449041 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Attempting to bind port be0ad184-b6ed-4693-96f3-e5167761a498 on network bd0479b2-da8e-41bd-929c-b9ece4aaa29f {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:19.449041 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:19.449041 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Checking segment: {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:19.449041 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:19.449041 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Bound using segment: {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:19.449041 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Bound port: be0ad184-b6ed-4693-96f3-e5167761a498, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:19.449041 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:19.496700 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:19.522447 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] For port be0ad184-b6ed-4693-96f3-e5167761a498, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:19.525646 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] For port be0ad184-b6ed-4693-96f3-e5167761a498, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=be0ad184-b6ed-4693-96f3-e5167761a498,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:19.533396 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:19.559582 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:19.587674 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:19.675485 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-753048eb-d77b-44ff-bf8d-081c00933916 None None] Pushing event updated for resources: {'Port': ['ID=be0ad184-b6ed-4693-96f3-e5167761a498,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:19.733971 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Pushing event updated for resources: {'Port': ['ID=0789f50b-915f-4c46-85b3-aa1902eb4af4,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:19.984512 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-672021c2-064d-44a9-9a31-3b11e7a67d4c req-2489aecc-95c0-4193-9c14-f215761a4ac6 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 210 time: 0.0655286 Nov 08 04:11:20.029191 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:20.257530 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:20.294011 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-30644ee5-4254-47b7-90f2-b9adccbd16c9 req-477d128c-f0a3-4d62-93e4-549fde6e265f tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.0640860 Nov 08 04:11:20.398577 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:20.460239 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:20.466919 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:20.523510 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Pushing event updated for resources: {'Port': ['ID=2d9dbcc2-e0b8-432f-805e-9d60c35596e4,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:20.529406 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device be0ad184-b6ed-4693-96f3-e5167761a498 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:20.605659 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:20.608923 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port be0ad184-b6ed-4693-96f3-e5167761a498 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:20.609347 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:20.653159 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ad5769a-3d95-434d-8f46-93cf2197578b None None] Network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:11:20.682266 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:20.689128 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:20.780881 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-d44525c4-f04a-4657-a5ae-5151fef1dbbe None None] Provisioning complete for port 495ffdd1-ff2f-4300-b636-fa1fcc35977b triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:20.781239 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d44525c4-f04a-4657-a5ae-5151fef1dbbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:20.977976 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.013093 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd041ea2-14d9-42c2-a707-093c27e1fad2 None None] Network bd0479b2-da8e-41bd-929c-b9ece4aaa29f requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:11:21.041316 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Allocated IP 172.27.2.8 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/83053c09-bb46-4b81-bc81-131ecfb62855) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:21.053302 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port be0ad184-b6ed-4693-96f3-e5167761a498, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=be0ad184-b6ed-4693-96f3-e5167761a498,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:21.113239 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.178109 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.179053 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 495ffdd1-ff2f-4300-b636-fa1fcc35977b up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:21.196895 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-701612', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891'] for router, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.227847 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be9f3bc6-f4d4-4b8d-a0a8-6e9dac98ba73 req-fc6a2127-a47a-4da5-8484-994d24e4e195 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 210 time: 0.0585685 Nov 08 04:11:21.318525 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d44525c4-f04a-4657-a5ae-5151fef1dbbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.363734 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=be0ad184-b6ed-4693-96f3-e5167761a498,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:21.413450 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 495ffdd1-ff2f-4300-b636-fa1fcc35977b triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:21.413450 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.417317 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-d44525c4-f04a-4657-a5ae-5151fef1dbbe None None] For port 495ffdd1-ff2f-4300-b636-fa1fcc35977b, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=495ffdd1-ff2f-4300-b636-fa1fcc35977b,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:21.508936 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fe817be4-986a-4053-a1f8-7c44d3b5d7a7 req-d70cdbe4-bc7a-49a0-8849-2075fc5079d6 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.0400343 Nov 08 04:11:21.509786 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.512353 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d44525c4-f04a-4657-a5ae-5151fef1dbbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.574112 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.612065 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d44525c4-f04a-4657-a5ae-5151fef1dbbe None None] Pushing event updated for resources: {'Port': ['ID=495ffdd1-ff2f-4300-b636-fa1fcc35977b,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:21.663710 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-c663a4b5-0bcb-45ae-a996-8c91be39e4a2 None None] Provisioning complete for port be0ad184-b6ed-4693-96f3-e5167761a498 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:21.664127 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c663a4b5-0bcb-45ae-a996-8c91be39e4a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.668398 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.db.api [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=101666) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 08 04:11:21.668764 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG oslo_db.api [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 08 04:11:21.688433 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-701612', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891'] for router, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.740760 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.787691 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:21.795657 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:21.827018 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:21.831334 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Router 02bab738-cfe2-4e4a-8864-2604a23990ee is scheduled to L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 with binding_index 1 {{(pid=101664) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 04:11:21.836405 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Pushing event updated for resources: {'Port': ['ID=83053c09-bb46-4b81-bc81-131ecfb62855,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:21.867542 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-862bfc62-edc8-4d39-8b0b-05c5904ec4f1 None None] Provisioning complete for port 495ffdd1-ff2f-4300-b636-fa1fcc35977b triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:21.867904 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-862bfc62-edc8-4d39-8b0b-05c5904ec4f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.961731 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-862bfc62-edc8-4d39-8b0b-05c5904ec4f1 None None] Provisioning complete for port be0ad184-b6ed-4693-96f3-e5167761a498 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:21.962090 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-862bfc62-edc8-4d39-8b0b-05c5904ec4f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:21.969908 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:11:22.075695 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:11:22.085753 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Sync routers for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:11:22.094553 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:22.095158 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:22.161512 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Router 38c2ccdd-af72-475c-872c-b75630dd8639 is scheduled to L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 with binding_index 1 {{(pid=101664) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 04:11:22.187627 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:22.192442 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-da9250f4-1151-4d5d-91b5-8ce7a4f4e653 admin admin] 10.222.0.21 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 5.4673791 Nov 08 04:11:22.192604 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 49116) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:22.231022 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:22.339899 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:22.361170 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c41e8334-de38-409c-97ef-a8216ce0d338 req-8e6a1673-ecfa-4481-a7d1-2f08b3a9d561 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 210 time: 0.0619004 Nov 08 04:11:22.390820 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:11:22.396358 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device be0ad184-b6ed-4693-96f3-e5167761a498 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:22.403299 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Sync routers for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:11:22.449168 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:22.449850 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:22.518082 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:22.519423 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-651328fb-7082-482d-b191-1c5d074b8772 admin admin] 10.222.0.21 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 4.8634329 Nov 08 04:11:22.520641 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-701612', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891'] for router, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:22.523355 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49120) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:22.551803 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port be0ad184-b6ed-4693-96f3-e5167761a498 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:22.552168 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:22.626840 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:19Z', 'revision_number': 3, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:22.653652 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:22.669606 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Checking router: 02bab738-cfe2-4e4a-8864-2604a23990ee for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:11:22.670626 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Updating router 02bab738-cfe2-4e4a-8864-2604a23990ee port 0789f50b-915f-4c46-85b3-aa1902eb4af4 binding host dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:11:22.679798 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-76383959-0286-4752-8327-05a9f44be6dc req-81b6b501-1651-4669-a56c-fbc0809dcd8a tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.0266719 Nov 08 04:11:22.701537 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:22.825009 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 495ffdd1-ff2f-4300-b636-fa1fcc35977b up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:22.986100 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:20Z', 'revision_number': 3, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:22.998452 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.034856 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 495ffdd1-ff2f-4300-b636-fa1fcc35977b triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:23.035736 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.039775 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Checking router: 38c2ccdd-af72-475c-872c-b75630dd8639 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:11:23.040643 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Updating router 38c2ccdd-af72-475c-872c-b75630dd8639 port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 binding host dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:11:23.044322 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Publish callbacks [] for port, precommit_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.083323 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Router cb8d019a-2021-4fe7-8fb4-9a6a6883591c is scheduled to L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 with binding_index 1 {{(pid=101664) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 04:11:23.104040 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.129866 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.194549 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Attempting to bind port 0789f50b-915f-4c46-85b3-aa1902eb4af4 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:23.195183 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Attempting to bind port 0789f50b-915f-4c46-85b3-aa1902eb4af4 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:23.195842 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Attempting to bind port 0789f50b-915f-4c46-85b3-aa1902eb4af4 on network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:23.204315 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Pushing event updated for resources: {'Port': ['ID=0789f50b-915f-4c46-85b3-aa1902eb4af4,revision_number=2']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:23.208537 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:23.209350 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101667) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:23.209953 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.221210 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Allocated IP 172.20.0.1 (6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e/20a91346-16ed-4174-9e29-b85a8dc77939/d1188efc-8b55-42aa-a864-2dbeb0fbe0a3) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:23.225789 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Bound using segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:23.226710 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Bound port: 0789f50b-915f-4c46-85b3-aa1902eb4af4, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:23.227370 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.250406 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.251014 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.251469 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.251907 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.252340 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.252775 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.253233 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.253653 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.254116 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.254569 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.261411 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.261902 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Tracked resource versions report: Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: pushed versions: Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: { 'AddressGroup': {'1.2'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'ConntrackHelper': {'1.0'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Log': {'1.0'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Network': {'1.1'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Port': {'1.7'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'PortForwarding': {'1.2'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'QosPolicy': {'1.10'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SecurityGroup': {'1.5'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SecurityGroupRule': {'1.2'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SubPort': {'1.0'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Subnet': {'1.1'}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Trunk': {'1.1'}} Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: consumer versions: Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: { DHCP agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: HyperV agent@hv-cinder-78364: {}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: L3 agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: Metadata agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: Metering agent@dv-cinder-783643-4-iscsi: {}, Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: Open vSwitch agent@dv-cinder-783643-4-iscsi: { 'AddressGroup': '1.2', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'ConntrackHelper': '1.0', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Log': '1.0', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Network': '1.1', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Port': '1.7', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'PortForwarding': '1.2', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'QosPolicy': '1.10', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SecurityGroup': '1.5', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SecurityGroupRule': '1.2', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'SubPort': '1.0', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Subnet': '1.1', Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: 'Trunk': '1.1'}} Nov 08 04:11:23.263741 dv-cinder-783643-4-iscsi neutron-server[101667]: {{(pid=101667) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 08 04:11:23.362049 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:11:23.393423 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Sync routers for ids ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:11:23.411598 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] For port 0789f50b-915f-4c46-85b3-aa1902eb4af4, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101667) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:23.432833 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] For port 0789f50b-915f-4c46-85b3-aa1902eb4af4, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0789f50b-915f-4c46-85b3-aa1902eb4af4,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101667) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:23.434118 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Routers {'cb8d019a-2021-4fe7-8fb4-9a6a6883591c'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:23.434864 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:23.460163 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.506011 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.570284 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31306f00-0e2a-4631-b510-42a252620fe8 req-08b66532-c953-4de8-9f52-c36e4d14d7b9 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 210 time: 0.0682909 Nov 08 04:11:23.586949 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.591585 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-c3f94fb4-6c43-460f-be2c-f715d6dc28a6 admin admin] 10.222.0.21 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 5.6159439 Nov 08 04:11:23.592649 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 49148) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:23.642979 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Set router cb8d019a-2021-4fe7-8fb4-9a6a6883591c gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:23.734645 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.752787 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.813758 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Publish callbacks [] for port, precommit_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.814374 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Pushing event updated for resources: {'Port': ['ID=d1188efc-8b55-42aa-a864-2dbeb0fbe0a3,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:23.845794 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5eb2093d-257a-4491-9fce-f53ae5165b09 req-4d3fe954-2536-41ae-835e-6c63280e986f tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.0277283 Nov 08 04:11:23.855883 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:23.858798 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:23.862795 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:23.863591 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-703278'] for router_interface, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.877047 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:23.923158 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:23.923795 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:23.952145 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb30e5fa-9c7d-48b4-832c-a78ceecf1673 None None] Pushing event updated for resources: {'Port': ['ID=2d9dbcc2-e0b8-432f-805e-9d60c35596e4,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:24.009735 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Attempting to bind port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:24.011138 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Attempting to bind port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:24.019525 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Attempting to bind port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 on network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:24.019525 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:24.020127 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:24.020677 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.021223 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Bound using segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:24.021754 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Bound port: 2d9dbcc2-e0b8-432f-805e-9d60c35596e4, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:24.022160 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17e02cef-5f3a-4f2b-b188-231aeb981f32 None None] Pushing event updated for resources: {'Port': ['ID=0789f50b-915f-4c46-85b3-aa1902eb4af4,revision_number=3']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:24.024066 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.125057 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] For port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:24.133789 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] For port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=2d9dbcc2-e0b8-432f-805e-9d60c35596e4,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:24.145644 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Allocated IP 172.20.0.1 (bd0479b2-da8e-41bd-929c-b9ece4aaa29f/1158e941-c129-49d0-9b8b-ba72d0ef6717/391cb1a2-87e0-4676-80f5-f6a5a4ed3c83) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:24.157504 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:24.214888 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.231326 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.321406 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.330127 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-router', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8'}], 'enable_snat': True}, 'gw_port_id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:21Z', 'revision_number': 3, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'gw_port': {'id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:8a:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:20Z', 'updated_at': '2021-11-08T04:11:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:24.345790 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.379534 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-00ad5fc4-6f15-4964-8693-09f743f7b8fd None None] Provisioning complete for port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:24.379861 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-00ad5fc4-6f15-4964-8693-09f743f7b8fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.383685 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb30e5fa-9c7d-48b4-832c-a78ceecf1673 None None] Pushing event updated for resources: {'Port': ['ID=2d9dbcc2-e0b8-432f-805e-9d60c35596e4,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:24.405303 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:24.412371 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:24.465533 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.479734 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-00ad5fc4-6f15-4964-8693-09f743f7b8fd None None] Port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:11:24.524186 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Checking router: cb8d019a-2021-4fe7-8fb4-9a6a6883591c for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:11:24.525062 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Updating router cb8d019a-2021-4fe7-8fb4-9a6a6883591c port 83053c09-bb46-4b81-bc81-131ecfb62855 binding host dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:11:24.564129 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.567003 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Network bd0479b2-da8e-41bd-929c-b9ece4aaa29f is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:24.570449 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:24.575356 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:24.582407 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:24.582958 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-703278'] for router_interface, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.698569 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:19Z', 'revision_number': 3, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:24.816224 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-79a42e21-310e-4671-b40b-e3ac6392f597 req-84026100-fc12-4264-9593-321de1d97ec0 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 210 time: 0.0816307 Nov 08 04:11:24.818789 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b83a1a39-7dcf-49a0-8500-3499bf2b1fff None None] The sync data for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi is: [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:19Z', 'revision_number': 3, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:11:24.859457 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.866346 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.16', 51197) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:24.890262 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:24.941110 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Pushing event updated for resources: {'Port': ['ID=391cb1a2-87e0-4676-80f5-f6a5a4ed3c83,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:25.023336 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:25.024792 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530987', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-703418'] for router_interface, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:25.039771 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 49186) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:25.114005 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-5e4a1bc2-7da2-4f54-bcee-848e364956fd None None] Provisioning complete for port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:25.114578 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5e4a1bc2-7da2-4f54-bcee-848e364956fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:25.156228 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-5e4a1bc2-7da2-4f54-bcee-848e364956fd None None] Port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:11:25.161022 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:20Z', 'revision_number': 3, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:25.205093 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-caa7522d-aee8-49d5-9d27-936b814406b9 None None] The sync data for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi is: [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:20Z', 'revision_number': 3, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:11:25.421142 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Publish callbacks [] for port, precommit_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:25.452064 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-8c0d1330-4eb0-4007-942f-b2741abd8ff9 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:25.457355 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-8c0d1330-4eb0-4007-942f-b2741abd8ff9 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "GET /v2.0/networks?id=1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 200 len: 814 time: 0.5899806 Nov 08 04:11:25.510848 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1baa66b2-a564-4903-93b8-b7cf9df0f128 req-3d83522a-9b92-49df-b39c-50429c3a3e94 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.3012841 Nov 08 04:11:25.549560 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:25.642753 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Allocated IP 172.20.0.1 (8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8/900a12a5-1baa-47e1-8b64-245dc70bc9f2/551b7e72-649c-47e4-b44e-23c03034da1e) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:25.652491 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Request body: {'port': {'device_id': 'dda4312d-16a9-4d15-9482-a296b62c88c1', 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc', 'admin_state_up': True, 'tenant_id': 'f3ecedce4bce4764a6bd2e0cc60c4955'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:25.655065 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a83f241c-0552-4bcf-a7b9-78e7bc653375 None None] Pushing event updated for resources: {'Port': ['ID=83053c09-bb46-4b81-bc81-131ecfb62855,revision_number=2']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:25.669594 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Pushing event updated for resources: {'Port': ['ID=d1188efc-8b55-42aa-a864-2dbeb0fbe0a3,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:25.679702 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ed22067b-0014-4165-99ea-fb88b28e6218 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:25.729753 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Attempting to bind port 83053c09-bb46-4b81-bc81-131ecfb62855 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:25.732999 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Attempting to bind port 83053c09-bb46-4b81-bc81-131ecfb62855 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:25.732999 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Attempting to bind port 83053c09-bb46-4b81-bc81-131ecfb62855 on network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:25.748741 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:25.749314 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101667) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:25.749817 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:25.750362 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Bound using segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:25.751622 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Bound port: 83053c09-bb46-4b81-bc81-131ecfb62855, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:25.751977 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:25.925112 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] For port 83053c09-bb46-4b81-bc81-131ecfb62855, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101667) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:25.932173 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:25.933725 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:25.935717 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] For port 83053c09-bb46-4b81-bc81-131ecfb62855, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=83053c09-bb46-4b81-bc81-131ecfb62855,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101667) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:25.950439 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.16', 51205) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:26.001560 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:26.055466 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:26.235011 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Routers {'cb8d019a-2021-4fe7-8fb4-9a6a6883591c'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:26.243589 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:26.243779 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-85d16d1e-37c1-460c-8c30-68a3cc5afc75 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:26.244030 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a83f241c-0552-4bcf-a7b9-78e7bc653375 None None] Pushing event updated for resources: {'Port': ['ID=83053c09-bb46-4b81-bc81-131ecfb62855,revision_number=3']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:26.274639 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-85d16d1e-37c1-460c-8c30-68a3cc5afc75 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.16 "GET /v2.0/networks?id=73a3dfba-be87-4070-93d2-b14149196c8c HTTP/1.1" status: 200 len: 811 time: 0.2579782 Nov 08 04:11:26.324418 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Request body: {'port': {'device_id': 'f882d66b-3620-4d68-9751-4f2683e2d565', 'network_id': '73a3dfba-be87-4070-93d2-b14149196c8c', 'admin_state_up': True, 'tenant_id': '10aa52c671b04a70bee6132d644fcea6'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:26.429800 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-c117981c-b307-4435-a963-64c191730117 None None] Provisioning complete for port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:26.430382 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c117981c-b307-4435-a963-64c191730117 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:26.510742 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-c117981c-b307-4435-a963-64c191730117 None None] Port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:11:26.546301 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:26.589984 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] Set router cb8d019a-2021-4fe7-8fb4-9a6a6883591c gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:26.594069 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Made reservation on behalf of f3ecedce4bce4764a6bd2e0cc60c4955 for: {'port': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:26.603347 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:26.678158 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:26.678545 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:26.807619 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:26.867005 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:26.867128 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-da23bc44-3066-4682-a4ca-a95b989b0701 req-b09b5005-c0c1-4d11-a4df-b9ce12876b18 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 210 time: 0.6511886 Nov 08 04:11:26.916638 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=2d9dbcc2-e0b8-432f-805e-9d60c35596e4,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:26.958980 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ed22067b-0014-4165-99ea-fb88b28e6218 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:26.959514 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-router', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8'}], 'enable_snat': True}, 'gw_port_id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:21Z', 'revision_number': 3, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'gw_port': {'id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:8a:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:20Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:26.961428 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-18c44aea-0a8e-4cba-abde-bcf07c2c44f3 req-7e227ab2-31d6-474b-b780-06d23247adf6 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.2669818 Nov 08 04:11:26.989173 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:26.990245 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0789f50b-915f-4c46-85b3-aa1902eb4af4 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:27.020379 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3b40715-9ba7-4250-9fd3-5c271ffd7c61 None None] The sync data for ids ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'] in dv-cinder-783643-4-iscsi is: [{'id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-router', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8'}], 'enable_snat': True}, 'gw_port_id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:21Z', 'revision_number': 3, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'gw_port': {'id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:8a:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:20Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:11:27.097463 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Router 02bab738-cfe2-4e4a-8864-2604a23990ee has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:11:27.117509 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ed22067b-0014-4165-99ea-fb88b28e6218 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:27.177906 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed22067b-0014-4165-99ea-fb88b28e6218 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0cbae2fb-8154-419c-bd8f-94b6ede20654,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:27.203477 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 49268) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:27.305283 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=2d9dbcc2-e0b8-432f-805e-9d60c35596e4,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:27.398460 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 0789f50b-915f-4c46-85b3-aa1902eb4af4 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:27.398996 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:27.410063 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:11:27.418457 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ed22067b-0014-4165-99ea-fb88b28e6218 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=5d7f5204a78d4c6bb22be708b5209c50&name=default HTTP/1.1" status: 200 len: 2992 time: 2.3193996 Nov 08 04:11:27.434101 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-69b5e492-b434-4989-bfcb-d5f2bc226a6d admin admin] 10.222.0.21 "PUT /v2.0/routers/02bab738-cfe2-4e4a-8864-2604a23990ee/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2323492 Nov 08 04:11:27.434101 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Made reservation on behalf of 10aa52c671b04a70bee6132d644fcea6 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:27.434419 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49276) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:27.437909 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:27.444981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:27.537884 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:27.537884 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Allocated IP 172.20.0.12 (1516eeae-19de-448e-9ebd-952b54f99dcc/59ccbcae-2516-4cc7-9077-478845e3e1f2/f790fbae-e681-4e01-b1a4-67513d491300) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:27.626263 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Pushing event updated for resources: {'Port': ['ID=551b7e72-649c-47e4-b44e-23c03034da1e,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:27.635785 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:27.639202 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1132bf98-e683-4971-b746-b42c64c0c8e1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:27.662196 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f62b7a7e-cebc-44f1-9568-2d7ecb9eb912 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:27.700334 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port 0789f50b-915f-4c46-85b3-aa1902eb4af4, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0789f50b-915f-4c46-85b3-aa1902eb4af4,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:28.039889 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f62b7a7e-cebc-44f1-9568-2d7ecb9eb912 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:28.039889 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:28.039889 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530987', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-703418'] for router_interface, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:28.046351 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:28.046351 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=0789f50b-915f-4c46-85b3-aa1902eb4af4,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:28.047824 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:28.070864 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:28.139461 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Network bd0479b2-da8e-41bd-929c-b9ece4aaa29f is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:28.149848 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:28.268866 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:28.269582 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-703278'] for router_interface, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:28.416618 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Allocated IP 172.20.0.7 (73a3dfba-be87-4070-93d2-b14149196c8c/e73cdb7b-96cb-4d2a-bf8a-e10140c5dc14/c8b44127-b903-47ea-98e3-772137eab0f6) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:28.432108 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eec31c76-daf6-4602-abbd-84d76793c33b req-7de1475b-ba58-452f-aefd-b23f1e56af5f tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 210 time: 0.1730466 Nov 08 04:11:28.719722 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-06fb3ce0-10c1-4e3c-ba4b-cd2d02b1bdf0 None None] Provisioning complete for port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:28.721265 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-06fb3ce0-10c1-4e3c-ba4b-cd2d02b1bdf0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:28.736444 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 83053c09-bb46-4b81-bc81-131ecfb62855 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:28.761922 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Pushing event updated for resources: {'Port': ['ID=391cb1a2-87e0-4676-80f5-f6a5a4ed3c83,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:28.785011 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Router 38c2ccdd-af72-475c-872c-b75630dd8639 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:11:28.820493 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1132bf98-e683-4971-b746-b42c64c0c8e1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:28.846147 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-06fb3ce0-10c1-4e3c-ba4b-cd2d02b1bdf0 None None] Port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:11:28.904406 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 83053c09-bb46-4b81-bc81-131ecfb62855 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:28.908064 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:28.921360 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:28.954632 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.020651 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6c4e1376-b667-4bc8-857f-75a50c52b40d req-f25afd38-1fd0-45fc-8de6-10a890d2d97a tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.0583405 Nov 08 04:11:29.053985 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Sync routers for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:11:29.106933 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1132bf98-e683-4971-b746-b42c64c0c8e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.108981 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f62b7a7e-cebc-44f1-9568-2d7ecb9eb912 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.111834 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f62b7a7e-cebc-44f1-9568-2d7ecb9eb912 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.113453 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f62b7a7e-cebc-44f1-9568-2d7ecb9eb912 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/0cbae2fb-8154-419c-bd8f-94b6ede20654 HTTP/1.1" status: 204 len: 168 time: 1.6626375 Nov 08 04:11:29.132131 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f62b7a7e-cebc-44f1-9568-2d7ecb9eb912 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cbae2fb-8154-419c-bd8f-94b6ede20654,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:29.143516 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.145084 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.157846 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49308) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:29.158273 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-1132bf98-e683-4971-b746-b42c64c0c8e1 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=8dbd4120d17449428020f6ca45b000c0&name=default HTTP/1.1" status: 200 len: 2992 time: 1.9482298 Nov 08 04:11:29.216019 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:29.216866 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:29.222792 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49310) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:29.240803 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-880bc5cf-319a-47c4-bf1b-3e2a81a49151 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'security_group': {'name': 'tempest-securitygroup--613512398', 'description': 'tempest-description--503605307'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:29.305046 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.311791 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:11:29.421916 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-880bc5cf-319a-47c4-bf1b-3e2a81a49151 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.575888 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-880bc5cf-319a-47c4-bf1b-3e2a81a49151 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.609040 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Sync routers for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:11:29.619300 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.625022 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:29.642630 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:29.667703 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port 83053c09-bb46-4b81-bc81-131ecfb62855, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=83053c09-bb46-4b81-bc81-131ecfb62855,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:29.668810 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-867dd2d8-cee8-43e1-b56f-45651e8cf7d0 admin admin] 10.222.0.21 "PUT /v2.0/routers/38c2ccdd-af72-475c-872c-b75630dd8639/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1434104 Nov 08 04:11:29.669717 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-08857605-b73d-4ddd-8ab8-28d3568c3406 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.672802 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Network 1516eeae-19de-448e-9ebd-952b54f99dcc is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:29.718841 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:29.723581 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:29.743441 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:29.744678 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.766224 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:29.788594 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Pushing event updated for resources: {'Port': ['ID=f790fbae-e681-4e01-b1a4-67513d491300,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:29.825089 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-880bc5cf-319a-47c4-bf1b-3e2a81a49151 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.863985 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1132bf98-e683-4971-b746-b42c64c0c8e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=231ee0f9-cc7c-4cf1-9845-1d38c45bbea1,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:29.870816 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-08857605-b73d-4ddd-8ab8-28d3568c3406 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.922331 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:29.942823 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Network 73a3dfba-be87-4070-93d2-b14149196c8c is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:29.949525 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:29.953007 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0789f50b-915f-4c46-85b3-aa1902eb4af4 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:29.974573 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:29.980081 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Pushing event updated for resources: {'Port': ['ID=c8b44127-b903-47ea-98e3-772137eab0f6,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:29.993336 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:30.003114 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:30.004175 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.008944 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-880bc5cf-319a-47c4-bf1b-3e2a81a49151 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5301efbc-e522-4603-b20e-2d3c40cd69c5,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:30.025124 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-f0bffbca-75f7-4dc1-97b1-352e68d3455d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.3777175 Nov 08 04:11:30.031875 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-880bc5cf-319a-47c4-bf1b-3e2a81a49151 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.045822 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-880bc5cf-319a-47c4-bf1b-3e2a81a49151 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1793 time: 0.8050177 Nov 08 04:11:30.048019 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49340) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:30.059075 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-502e4808-f84b-4dc9-920d-57cb4ddbd848 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101664) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:11:30.062434 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-502e4808-f84b-4dc9-920d-57cb4ddbd848 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0184700 Nov 08 04:11:30.071586 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-56015d94-44ec-4aec-aacd-9b4c0d485d89 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'security_group_rule': {'security_group_id': '5301efbc-e522-4603-b20e-2d3c40cd69c5', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:30.173343 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.221560 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1309e2c0-7806-42d0-aa98-d293af8c3b26 req-7fdbd5bf-d1e8-4e5c-8314-7f217034bc24 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:30.236677 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-08857605-b73d-4ddd-8ab8-28d3568c3406 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.240998 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-08857605-b73d-4ddd-8ab8-28d3568c3406 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.242143 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-08857605-b73d-4ddd-8ab8-28d3568c3406 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/231ee0f9-cc7c-4cf1-9845-1d38c45bbea1 HTTP/1.1" status: 204 len: 168 time: 1.0827103 Nov 08 04:11:30.248850 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1309e2c0-7806-42d0-aa98-d293af8c3b26 req-7fdbd5bf-d1e8-4e5c-8314-7f217034bc24 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 931 time: 0.6645756 Nov 08 04:11:30.259490 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-56015d94-44ec-4aec-aacd-9b4c0d485d89 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.293121 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.296430 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530987', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-703418'] for router_interface, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.328335 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08857605-b73d-4ddd-8ab8-28d3568c3406 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=231ee0f9-cc7c-4cf1-9845-1d38c45bbea1,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:30.411144 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-368e4ddf-3502-45be-ac80-1c92fe8414a5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.1147945 Nov 08 04:11:30.540186 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-56015d94-44ec-4aec-aacd-9b4c0d485d89 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.549671 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1309e2c0-7806-42d0-aa98-d293af8c3b26 req-90af72e5-f7f4-4263-9429-df368d92f938 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3000987 Nov 08 04:11:30.606169 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-56015d94-44ec-4aec-aacd-9b4c0d485d89 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.633046 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Pushing event updated for resources: {'Port': ['ID=551b7e72-649c-47e4-b44e-23c03034da1e,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:30.667241 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56015d94-44ec-4aec-aacd-9b4c0d485d89 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2df919d0-c592-4f57-8c85-862a268fa5ed,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:30.777448 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-56015d94-44ec-4aec-aacd-9b4c0d485d89 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.784051 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-56015d94-44ec-4aec-aacd-9b4c0d485d89 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7147927 Nov 08 04:11:30.784051 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49352) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:30.784494 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 2, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:30.791769 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-aa6eea96-3218-46eb-af56-a4ed635c85eb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'security_group_rule': {'security_group_id': '5301efbc-e522-4603-b20e-2d3c40cd69c5', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:30.798299 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bad3139-f0fe-44b9-8c19-2836fa78d99c req-6249c1be-ef5f-40e8-9391-bc650875b0d6 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:30.799892 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1bad3139-f0fe-44b9-8c19-2836fa78d99c req-6249c1be-ef5f-40e8-9391-bc650875b0d6 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 932 time: 0.1574736 Nov 08 04:11:30.815475 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 49354) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:30.819463 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:30.849537 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:30.867524 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Checking router: 38c2ccdd-af72-475c-872c-b75630dd8639 for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:11:30.868878 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Updating router 38c2ccdd-af72-475c-872c-b75630dd8639 port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 binding host dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:11:30.883624 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b259cd73-1d2e-4167-8685-3feae4746a00 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:30.952330 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa6eea96-3218-46eb-af56-a4ed635c85eb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.013956 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1bad3139-f0fe-44b9-8c19-2836fa78d99c req-cfdc4ce7-abec-4511-8ae9-a7b4c3ba06e5 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2024305 Nov 08 04:11:31.067444 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Request body: {'port': {'device_id': 'dda4312d-16a9-4d15-9482-a296b62c88c1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:31.080674 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.082366 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49360) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:31.102688 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=83053c09-bb46-4b81-bc81-131ecfb62855,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:31.117674 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 0789f50b-915f-4c46-85b3-aa1902eb4af4 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:31.118311 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.131501 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Request body: {'port': {'device_id': 'f882d66b-3620-4d68-9751-4f2683e2d565', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:31.172385 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 2, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:31.183668 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-dcb65b2b-4e9a-4d79-92f9-e7921c2638da tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1828984374', 'description': 'tempest-description--525641970'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:31.234134 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Router cb8d019a-2021-4fe7-8fb4-9a6a6883591c has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:11:31.239339 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.295585 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b259cd73-1d2e-4167-8685-3feae4746a00 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.375150 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:31.379168 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b259cd73-1d2e-4167-8685-3feae4746a00 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.431370 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dcb65b2b-4e9a-4d79-92f9-e7921c2638da tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.439855 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Checking router: 02bab738-cfe2-4e4a-8864-2604a23990ee for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:11:31.442859 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Updating router 02bab738-cfe2-4e4a-8864-2604a23990ee port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 binding host dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:11:31.499580 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa6eea96-3218-46eb-af56-a4ed635c85eb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.501586 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.553536 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b259cd73-1d2e-4167-8685-3feae4746a00 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=7bdfc46f821e4488a0d5e1389d412554&name=default HTTP/1.1" status: 200 len: 2995 time: 0.7341752 Nov 08 04:11:31.556305 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49376) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:31.632107 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.632487 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b259cd73-1d2e-4167-8685-3feae4746a00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c5e1c963-2f3b-4cc0-9d87-328ad91aba1a,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:31.700334 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:31.700970 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.766791 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-26b2be99-4c63-4ae6-a226-970a219f7e0c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.794563 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-26b2be99-4c63-4ae6-a226-970a219f7e0c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.796810 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:11:31.835081 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-fc3dfd3f-9630-48c0-ab14-7b36fa5dd1ad admin admin] 10.222.0.21 "PUT /v2.0/routers/cb8d019a-2021-4fe7-8fb4-9a6a6883591c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.2417336 Nov 08 04:11:31.838201 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa6eea96-3218-46eb-af56-a4ed635c85eb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:31.855159 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Sync routers for ids ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:11:32.001134 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Publish callbacks [] for port, precommit_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.047159 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d926de0-d971-4e0b-a306-4d76d9deb8a2 req-83f14fb7-aca7-4f8a-811e-89ab4a57d523 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:32.072247 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9d926de0-d971-4e0b-a306-4d76d9deb8a2 req-83f14fb7-aca7-4f8a-811e-89ab4a57d523 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 931 time: 0.4070189 Nov 08 04:11:32.209179 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Routers {'cb8d019a-2021-4fe7-8fb4-9a6a6883591c'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:32.209840 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:32.286470 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.351772 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9d926de0-d971-4e0b-a306-4d76d9deb8a2 req-3461400a-6d7d-4d2e-a365-4cf9b54f46e5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2666864 Nov 08 04:11:32.380881 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6eea96-3218-46eb-af56-a4ed635c85eb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=36ec33e5-e13c-4e68-b70c-d72b804b9b26,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:32.386391 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dcb65b2b-4e9a-4d79-92f9-e7921c2638da tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.477417 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa6eea96-3218-46eb-af56-a4ed635c85eb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.480382 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Publish callbacks [] for port, precommit_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.488734 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faba4894-fc1f-43d9-ba63-079b1077aeb9 req-3b99b70b-62e6-464f-937e-a6151633793e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:32.499855 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-aa6eea96-3218-46eb-af56-a4ed635c85eb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.7146957 Nov 08 04:11:32.503228 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49394) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:32.507995 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-faba4894-fc1f-43d9-ba63-079b1077aeb9 req-3b99b70b-62e6-464f-937e-a6151633793e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 932 time: 0.3480034 Nov 08 04:11:32.531255 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'floatingip': {'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:32.596705 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c8b44127-b903-47ea-98e3-772137eab0f6 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:32.627276 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dcb65b2b-4e9a-4d79-92f9-e7921c2638da tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.675086 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b0208c-664f-4a36-8f3c-7e15637c05e0 None None] Pushing event updated for resources: {'Port': ['ID=391cb1a2-87e0-4676-80f5-f6a5a4ed3c83,revision_number=3']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:32.711752 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 83053c09-bb46-4b81-bc81-131ecfb62855 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:32.762526 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.836150 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-26b2be99-4c63-4ae6-a226-970a219f7e0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.839305 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-26b2be99-4c63-4ae6-a226-970a219f7e0c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.842884 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-26b2be99-4c63-4ae6-a226-970a219f7e0c admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/c5e1c963-2f3b-4cc0-9d87-328ad91aba1a HTTP/1.1" status: 204 len: 168 time: 1.2826707 Nov 08 04:11:32.860390 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcb65b2b-4e9a-4d79-92f9-e7921c2638da tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6e7fcf69-0275-47ef-809e-470976ce212d,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:32.865986 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Attempting to bind port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:32.866832 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Attempting to bind port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:32.868125 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Attempting to bind port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 on network bd0479b2-da8e-41bd-929c-b9ece4aaa29f {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:32.884040 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26b2be99-4c63-4ae6-a226-970a219f7e0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c5e1c963-2f3b-4cc0-9d87-328ad91aba1a,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:32.887427 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:32.888504 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Checking segment: {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101667) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:32.889364 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.890693 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Bound using segment: {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:32.892983 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Bound port: 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'}}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:32.893402 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.929297 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Transition to ACTIVE for port object c8b44127-b903-47ea-98e3-772137eab0f6 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:11:32.935316 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-faba4894-fc1f-43d9-ba63-079b1077aeb9 req-0c6e75e3-f57b-4bd7-a9f8-2841f20b1991 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4158549 Nov 08 04:11:32.943606 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:32.962079 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.013424 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.041522 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dcb65b2b-4e9a-4d79-92f9-e7921c2638da tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.045623 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-dcb65b2b-4e9a-4d79-92f9-e7921c2638da tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 1.9609413 Nov 08 04:11:33.049731 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49412) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:33.083096 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-41b3cba9-6263-4aa0-a574-a185825db4cd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'security_group_rule': {'security_group_id': '6e7fcf69-0275-47ef-809e-470976ce212d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:33.132193 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f1301f-69f2-43ec-b95b-6a8125156af4 None None] Pushing event updated for resources: {'Port': ['ID=d1188efc-8b55-42aa-a864-2dbeb0fbe0a3,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:33.146936 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Set router cb8d019a-2021-4fe7-8fb4-9a6a6883591c gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:33.175515 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] For port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101667) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:33.195235 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] For port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=391cb1a2-87e0-4676-80f5-f6a5a4ed3c83,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101667) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:33.202100 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8b30891a-a150-4412-80a0-160659316802 None None] Provisioning complete for port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:33.203710 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8b30891a-a150-4412-80a0-160659316802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.253143 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Pushing event updated for resources: {'Port': ['ID=c8b44127-b903-47ea-98e3-772137eab0f6,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:33.313484 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8b30891a-a150-4412-80a0-160659316802 None None] Port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:11:33.315035 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 83053c09-bb46-4b81-bc81-131ecfb62855 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:33.315418 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.318839 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Attempting to bind port c8b44127-b903-47ea-98e3-772137eab0f6 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:33.319216 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Attempting to bind port c8b44127-b903-47ea-98e3-772137eab0f6 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '40c10b14-9bad-4182-9d99-8cce48b6c4f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '73a3dfba-be87-4070-93d2-b14149196c8c'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:33.319616 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Attempting to bind port c8b44127-b903-47ea-98e3-772137eab0f6 on network 73a3dfba-be87-4070-93d2-b14149196c8c {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:33.366332 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Port c8b44127-b903-47ea-98e3-772137eab0f6 on network 73a3dfba-be87-4070-93d2-b14149196c8c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:11:33.367834 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Attempting to bind port c8b44127-b903-47ea-98e3-772137eab0f6 on network 73a3dfba-be87-4070-93d2-b14149196c8c {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:33.381338 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f790fbae-e681-4e01-b1a4-67513d491300 {{(pid=101664) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:33.390861 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.396237 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.417921 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:33.423487 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Checking segment: {'id': '40c10b14-9bad-4182-9d99-8cce48b6c4f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '73a3dfba-be87-4070-93d2-b14149196c8c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:33.423487 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Bound using segment: {'id': '40c10b14-9bad-4182-9d99-8cce48b6c4f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '73a3dfba-be87-4070-93d2-b14149196c8c'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:33.423487 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Bound port: c8b44127-b903-47ea-98e3-772137eab0f6, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '40c10b14-9bad-4182-9d99-8cce48b6c4f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 152, 'network_id': '73a3dfba-be87-4070-93d2-b14149196c8c'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:33.423487 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.438779 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.provisioning_blocks [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Transition to ACTIVE for port object f790fbae-e681-4e01-b1a4-67513d491300 will not be triggered until provisioned by entity L2. {{(pid=101664) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:11:33.512766 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-41b3cba9-6263-4aa0-a574-a185825db4cd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.643150 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.651101 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b0208c-664f-4a36-8f3c-7e15637c05e0 None None] Pushing event updated for resources: {'Port': ['ID=391cb1a2-87e0-4676-80f5-f6a5a4ed3c83,revision_number=4']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:33.666592 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Attempting to bind port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:33.666592 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Attempting to bind port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:33.666592 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Attempting to bind port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 on network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:33.677104 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-610efb87-b90e-493b-b4dc-bd72d8a0a3e8 None None] Provisioning complete for port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:33.679245 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-610efb87-b90e-493b-b4dc-bd72d8a0a3e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.703563 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:33.704461 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:33.721177 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:33.723790 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Checking segment: {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:33.723790 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.723790 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Bound using segment: {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:33.723790 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Bound port: d1188efc-8b55-42aa-a864-2dbeb0fbe0a3, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:33.723790 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.896471 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-41b3cba9-6263-4aa0-a574-a185825db4cd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:33.916459 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Pushing event updated for resources: {'Port': ['ID=f790fbae-e681-4e01-b1a4-67513d491300,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:33.972486 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-610efb87-b90e-493b-b4dc-bd72d8a0a3e8 None None] Port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:11:33.981782 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:34.026994 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:34.088155 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-41b3cba9-6263-4aa0-a574-a185825db4cd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:34.116897 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] For port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:34.139392 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] For port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=d1188efc-8b55-42aa-a864-2dbeb0fbe0a3,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:34.177186 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-839f80d1-64cd-4a68-8eb5-956fd3bc5e26 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:34.184993 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-router', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8'}], 'enable_snat': True}, 'gw_port_id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:28Z', 'revision_number': 4, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'gw_port': {'id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:8a:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:20Z', 'updated_at': '2021-11-08T04:11:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '551b7e72-649c-47e4-b44e-23c03034da1e', 'name': '', 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'mac_address': 'fa:16:3e:f5:9f:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '900a12a5-1baa-47e1-8b64-245dc70bc9f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:24Z', 'updated_at': '2021-11-08T04:11:29Z', 'revision_number': 2, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'subnets': [{'id': '900a12a5-1baa-47e1-8b64-245dc70bc9f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:34.185196 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-839f80d1-64cd-4a68-8eb5-956fd3bc5e26 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 819 time: 0.8589532 Nov 08 04:11:34.195902 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Attempting to bind port f790fbae-e681-4e01-b1a4-67513d491300 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:34.198527 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Attempting to bind port f790fbae-e681-4e01-b1a4-67513d491300 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'}] {{(pid=101664) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:34.199840 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Attempting to bind port f790fbae-e681-4e01-b1a4-67513d491300 on network 1516eeae-19de-448e-9ebd-952b54f99dcc {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:34.225005 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbb6e06-d68f-4de4-9312-4865d7530656 req-74d53878-b02e-4abd-8715-502fb8a9876a tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:34.228155 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-adbb6e06-d68f-4de4-9312-4865d7530656 req-74d53878-b02e-4abd-8715-502fb8a9876a tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 943 time: 0.6115677 Nov 08 04:11:34.236712 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:34.241763 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Checking router: cb8d019a-2021-4fe7-8fb4-9a6a6883591c for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:11:34.242128 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Updating router cb8d019a-2021-4fe7-8fb4-9a6a6883591c port 551b7e72-649c-47e4-b44e-23c03034da1e binding host dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:11:34.248301 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41b3cba9-6263-4aa0-a574-a185825db4cd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ffb9d820-753a-4106-8ffb-b0ce5d2782cf,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:34.265787 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Port f790fbae-e681-4e01-b1a4-67513d491300 on network 1516eeae-19de-448e-9ebd-952b54f99dcc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:11:34.265787 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Attempting to bind port f790fbae-e681-4e01-b1a4-67513d491300 on network 1516eeae-19de-448e-9ebd-952b54f99dcc {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:34.273082 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-887564d4-c17b-47b8-b1a7-32d20ea4b0ac tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/quotas/e9678ed98e7944babc4f6af7fb368440 HTTP/1.1" status: 200 len: 375 time: 0.0278606 Nov 08 04:11:34.291739 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] For port c8b44127-b903-47ea-98e3-772137eab0f6, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:34.308254 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:34.308254 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Checking segment: {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:34.308254 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Bound using segment: {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'} {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:34.308254 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Bound port: f790fbae-e681-4e01-b1a4-67513d491300, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'}}] {{(pid=101664) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:34.308254 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:34.397496 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] For port c8b44127-b903-47ea-98e3-772137eab0f6, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=c8b44127-b903-47ea-98e3-772137eab0f6,segment=NetworkSegment(40c10b14-9bad-4182-9d99-8cce48b6c4f8),segment_id=40c10b14-9bad-4182-9d99-8cce48b6c4f8)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:34.407690 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:34.412916 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-474f546c-299d-4f79-ade6-86b2d53b7dd3 None None] Provisioning complete for port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:34.413286 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-474f546c-299d-4f79-ade6-86b2d53b7dd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:34.420321 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-41b3cba9-6263-4aa0-a574-a185825db4cd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:34.421559 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-41b3cba9-6263-4aa0-a574-a185825db4cd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.3705089 Nov 08 04:11:34.425703 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49444) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:34.433742 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-6e6211d9-d97e-4218-b0be-a83613c81b8e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'security_group_rule': {'security_group_id': '6e7fcf69-0275-47ef-809e-470976ce212d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:34.484700 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-889fbe89-6345-45ae-b0b4-d9e9c505bc62 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2097044 Nov 08 04:11:34.503357 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:34.526923 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-adbb6e06-d68f-4de4-9312-4865d7530656 req-ece542ef-a6c7-44bd-a807-4318f3de84e2 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2379730 Nov 08 04:11:34.529986 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:34.530642 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:34.596020 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Allocated IP 172.27.2.56 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/612109a2-fe18-4eb8-8e67-0167cc19f3eb) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:34.656306 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:33Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:34.726320 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] For port f790fbae-e681-4e01-b1a4-67513d491300, host hv-cinder-78364, cleared binding levels {{(pid=101664) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:34.735927 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-534be873-6bce-488f-841b-4bbbc7e228d2 None None] The sync data for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi is: [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:33Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:11:34.790223 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] For port f790fbae-e681-4e01-b1a4-67513d491300, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=f790fbae-e681-4e01-b1a4-67513d491300,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101664) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:34.846515 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6e6211d9-d97e-4218-b0be-a83613c81b8e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:34.874134 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:34.883116 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:34.885267 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] 10.222.0.16 "PUT /v2.0/ports/c8b44127-b903-47ea-98e3-772137eab0f6 HTTP/1.1" status: 200 len: 1093 time: 4.4227741 Nov 08 04:11:34.887390 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f882d66b-3620-4d68-9751-4f2683e2d565', 'tag': 'c8b44127-b903-47ea-98e3-772137eab0f6'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:11:34.897632 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f1301f-69f2-43ec-b95b-6a8125156af4 None None] Pushing event updated for resources: {'Port': ['ID=d1188efc-8b55-42aa-a864-2dbeb0fbe0a3,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:34.917382 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:35.055545 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:35.152020 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:35.152671 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:35.154143 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] 10.222.0.16 "PUT /v2.0/ports/f790fbae-e681-4e01-b1a4-67513d491300 HTTP/1.1" status: 200 len: 1094 time: 4.7870798 Nov 08 04:11:35.156598 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dda4312d-16a9-4d15-9482-a296b62c88c1', 'tag': 'f790fbae-e681-4e01-b1a4-67513d491300'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:11:35.208394 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8788c208-db04-4a29-9a4f-54b88f294683 service neutron] Pushing event updated for resources: {'Port': ['ID=c8b44127-b903-47ea-98e3-772137eab0f6,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:35.259230 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49454) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:35.287359 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:35.322608 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bb7a9c2-5d76-4287-8231-adb7a77da423 service neutron] Pushing event updated for resources: {'Port': ['ID=f790fbae-e681-4e01-b1a4-67513d491300,revision_number=3']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:35.384193 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6e6211d9-d97e-4218-b0be-a83613c81b8e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:35.500045 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aacb6a2-8714-4fb1-90ae-2c72093a60b1 req-ab0ed074-4a18-456e-87b1-73fe101586d4 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:35.505707 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6aacb6a2-8714-4fb1-90ae-2c72093a60b1 req-ab0ed074-4a18-456e-87b1-73fe101586d4 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 944 time: 0.7368567 Nov 08 04:11:35.510415 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-bb39f354-f97a-4d95-9aa9-c82c69acc555 service neutron] 10.222.0.21 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0241022 Nov 08 04:11:35.519333 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6e6211d9-d97e-4218-b0be-a83613c81b8e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:35.522205 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:35.529983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-e69170b0-e526-4ffa-8d28-92ce14ff5e23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:35.549234 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-e69170b0-e526-4ffa-8d28-92ce14ff5e23 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=10aa52c671b04a70bee6132d644fcea6&device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 1096 time: 0.3476818 Nov 08 04:11:35.697679 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e6211d9-d97e-4218-b0be-a83613c81b8e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=398edfe7-fac3-4107-bae6-b7e6f4ba1ba2,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:35.765609 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:35.804799 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:35.814394 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:35.851233 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-474f546c-299d-4f79-ade6-86b2d53b7dd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:35.879020 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-7b919887-1e3b-42e6-96c5-b24bb060a919 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:35.887979 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-7b919887-1e3b-42e6-96c5-b24bb060a919 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 1097 time: 0.5265715 Nov 08 04:11:35.890765 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'Port': ['ID=612109a2-fe18-4eb8-8e67-0167cc19f3eb,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:35.897457 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bdf294a0-fd30-4286-aa2d-42b75ef3a7aa admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:35.915904 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-633a9ae8-9b0c-4454-b496-2bb5714a64cd service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c8b44127-b903-47ea-98e3-772137eab0f6 HTTP/1.1" status: 200 len: 217 time: 0.3204873 Nov 08 04:11:35.968375 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6e6211d9-d97e-4218-b0be-a83613c81b8e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:35.974937 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-6e6211d9-d97e-4218-b0be-a83613c81b8e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.5471244 Nov 08 04:11:36.018568 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49472) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:36.037298 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6250a4f6-776c-490d-b9e1-4af617d7ef80" -d '{"events": [{"name": "network-changed", "server_uuid": "f882d66b-3620-4d68-9751-4f2683e2d565", "tag": "c8b44127-b903-47ea-98e3-772137eab0f6"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:11:36.042167 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-474f546c-299d-4f79-ade6-86b2d53b7dd3 None None] For port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=391cb1a2-87e0-4676-80f5-f6a5a4ed3c83,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:36.053161 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'floatingip': {'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:36.106303 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6aacb6a2-8714-4fb1-90ae-2c72093a60b1 req-6bc6d2aa-aebf-4083-ba60-8e4971be3bb0 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5790610 Nov 08 04:11:36.183695 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-1fbb58ce-b06a-4fcc-a06c-a706b7639917 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:36.192978 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-1fbb58ce-b06a-4fcc-a06c-a706b7639917 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=e73cdb7b-96cb-4d2a-bf8a-e10140c5dc14 HTTP/1.1" status: 200 len: 851 time: 0.2417376 Nov 08 04:11:36.201686 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-95a346a5-28af-4e2b-a442-ab996a84158b" -d '{"events": [{"name": "network-changed", "server_uuid": "dda4312d-16a9-4d15-9482-a296b62c88c1", "tag": "f790fbae-e681-4e01-b1a4-67513d491300"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:11:36.227769 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:34Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:36.243343 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-474f546c-299d-4f79-ade6-86b2d53b7dd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:36.280367 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-bf664a45-5dac-48dc-bae6-da92fc7289cf service neutron] 10.222.0.21 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7689803 Nov 08 04:11:36.305310 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-7d42c6ee-8dda-49fe-a17d-f593669155fe service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=73a3dfba-be87-4070-93d2-b14149196c8c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0939479 Nov 08 04:11:36.307777 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:36.340340 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85043005-aeda-4fe0-885a-5772fa2d6736 None None] The sync data for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi is: [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:34Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:11:36.349373 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Publish callbacks [] for port, precommit_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:36.449778 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-d91c3aa2-2a8b-4da5-ae06-c913465144d0 None None] Provisioning complete for port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:36.450531 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d91c3aa2-2a8b-4da5-ae06-c913465144d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:36.486816 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-474f546c-299d-4f79-ade6-86b2d53b7dd3 None None] Pushing event updated for resources: {'Port': ['ID=391cb1a2-87e0-4676-80f5-f6a5a4ed3c83,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:36.518218 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-388bb86e-9585-4152-ad80-1476eb7a692d service neutron] 10.222.0.16 "GET /v2.0/networks/73a3dfba-be87-4070-93d2-b14149196c8c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1658833 Nov 08 04:11:36.698608 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:36.702241 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-10493dd0-5c88-4fd1-856b-3cbb12e89e48 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f790fbae-e681-4e01-b1a4-67513d491300 HTTP/1.1" status: 200 len: 217 time: 0.6916533 Nov 08 04:11:36.718189 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d91c3aa2-2a8b-4da5-ae06-c913465144d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:36.793622 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed6526a-3dce-435c-9f12-27375fc012c0 req-9dd374d6-a4b2-4861-9a09-578a781c12df tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:36.833407 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4ed6526a-3dce-435c-9f12-27375fc012c0 req-9dd374d6-a4b2-4861-9a09-578a781c12df tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 943 time: 0.5794399 Nov 08 04:11:36.874344 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:36.924922 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:36.947571 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8636f638-ad3c-46dd-a00e-5f8fbfab989a None None] Pushing event updated for resources: {'Port': ['ID=551b7e72-649c-47e4-b44e-23c03034da1e,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:36.989961 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:36.993159 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4ed6526a-3dce-435c-9f12-27375fc012c0 req-7781b7ad-e734-49c0-a2ca-d5e992570b27 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1558726 Nov 08 04:11:37.008560 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25141c69-68f9-48ff-9b5d-8958f640b733 req-e0bae420-e35d-45b5-8974-14151da5d6df service neutron] 10.222.0.16 "GET /v2.0/networks/73a3dfba-be87-4070-93d2-b14149196c8c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4693267 Nov 08 04:11:37.045422 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bdf294a0-fd30-4286-aa2d-42b75ef3a7aa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:37.056350 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-4c05cbb1-7b8b-4e20-b74b-931e32f2f5ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:37.058984 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-4c05cbb1-7b8b-4e20-b74b-931e32f2f5ab service neutron] 10.222.0.16 "GET /v2.0/subnets?id=59ccbcae-2516-4cc7-9077-478845e3e1f2 HTTP/1.1" status: 200 len: 854 time: 0.3436720 Nov 08 04:11:37.113811 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-d91c3aa2-2a8b-4da5-ae06-c913465144d0 None None] For port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=d1188efc-8b55-42aa-a864-2dbeb0fbe0a3,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:37.158837 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Attempting to bind port 551b7e72-649c-47e4-b44e-23c03034da1e on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:37.159222 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Attempting to bind port 551b7e72-649c-47e4-b44e-23c03034da1e by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:37.159570 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Attempting to bind port 551b7e72-649c-47e4-b44e-23c03034da1e on network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:37.164874 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:37.167439 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Checking segment: {'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:37.167439 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:37.167439 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Bound using segment: {'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:37.167439 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Bound port: 551b7e72-649c-47e4-b44e-23c03034da1e, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:37.167439 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:37.185541 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bdf294a0-fd30-4286-aa2d-42b75ef3a7aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:37.196452 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-0a364640-d63e-4e24-a6d9-0e99e1f550be service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1516eeae-19de-448e-9ebd-952b54f99dcc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1006370 Nov 08 04:11:37.260751 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:37.262798 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:37.317955 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d91c3aa2-2a8b-4da5-ae06-c913465144d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:37.423715 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:11:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4faca829-444b-44f7-a34e-1d97f561d552 x-openstack-request-id: req-4faca829-444b-44f7-a34e-1d97f561d552 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:11:37.424013 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f882d66b-3620-4d68-9751-4f2683e2d565", "tag": "c8b44127-b903-47ea-98e3-772137eab0f6", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:11:37.424259 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-4faca829-444b-44f7-a34e-1d97f561d552 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:11:37.424873 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f882d66b-3620-4d68-9751-4f2683e2d565', 'tag': 'c8b44127-b903-47ea-98e3-772137eab0f6', 'status': 'completed', 'code': 200} Nov 08 04:11:37.595004 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fdc0785b-210b-4931-9b20-ff85a7acf056 req-b1827e6f-85b8-4ddb-b236-928d955e9ff0 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 210 time: 0.0972011 Nov 08 04:11:37.718009 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:37.720188 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d91c3aa2-2a8b-4da5-ae06-c913465144d0 None None] Pushing event updated for resources: {'Port': ['ID=d1188efc-8b55-42aa-a864-2dbeb0fbe0a3,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:37.721772 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 49512) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:37.726774 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] For port 551b7e72-649c-47e4-b44e-23c03034da1e, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:37.751676 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] For port 551b7e72-649c-47e4-b44e-23c03034da1e, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=551b7e72-649c-47e4-b44e-23c03034da1e,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:37.816893 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:11:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3b4b5f36-a555-42b6-9fe1-02598140c417 x-openstack-request-id: req-3b4b5f36-a555-42b6-9fe1-02598140c417 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:11:37.817450 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dda4312d-16a9-4d15-9482-a296b62c88c1", "tag": "f790fbae-e681-4e01-b1a4-67513d491300", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:11:37.817918 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-3b4b5f36-a555-42b6-9fe1-02598140c417 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:11:37.818526 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dda4312d-16a9-4d15-9482-a296b62c88c1', 'tag': 'f790fbae-e681-4e01-b1a4-67513d491300', 'status': 'completed', 'code': 200} Nov 08 04:11:37.839605 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-bdf294a0-fd30-4286-aa2d-42b75ef3a7aa admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=44c426d68d234c89818c0a64c559384d&name=default HTTP/1.1" status: 200 len: 2996 time: 2.5771000 Nov 08 04:11:37.840660 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdf294a0-fd30-4286-aa2d-42b75ef3a7aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=433d2a25-693d-4d75-96ea-22fbbe3475f9,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:37.857001 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49520) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:37.895069 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:38.006807 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6250a4f6-776c-490d-b9e1-4af617d7ef80 req-ff6d6cf3-c82e-41ce-94c0-0c6f9d19176a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:38.006807 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6250a4f6-776c-490d-b9e1-4af617d7ef80 req-ff6d6cf3-c82e-41ce-94c0-0c6f9d19176a service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=10aa52c671b04a70bee6132d644fcea6&device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 1096 time: 0.4199317 Nov 08 04:11:38.038507 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a5a2af-a263-4718-89d4-591795cec36f req-1bd7dc5f-6916-4f21-b543-7cb768f5ada5 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:38.040056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-44a5a2af-a263-4718-89d4-591795cec36f req-1bd7dc5f-6916-4f21-b543-7cb768f5ada5 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 944 time: 0.2568367 Nov 08 04:11:38.159614 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8636f638-ad3c-46dd-a00e-5f8fbfab989a None None] Pushing event updated for resources: {'Port': ['ID=551b7e72-649c-47e4-b44e-23c03034da1e,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:38.202944 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-44a5a2af-a263-4718-89d4-591795cec36f req-5c74b8a9-ade7-42d4-b8da-8c4afad8b432 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1522188 Nov 08 04:11:38.210590 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Routers {'cb8d019a-2021-4fe7-8fb4-9a6a6883591c'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:11:38.210590 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:38.236366 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ab0eca40-f2f7-4a74-b6c0-6710eb402fbc admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:38.246224 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-bb283581-0b39-4e56-912e-59ac8e8adf32 service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0158179 Nov 08 04:11:38.276636 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:38.328730 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:38.387003 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a477a96f-1447-435b-bbca-970597b925a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:38.401434 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:38.416220 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:38.416220 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:38.577092 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:38.677722 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a477a96f-1447-435b-bbca-970597b925a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:38.732730 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6250a4f6-776c-490d-b9e1-4af617d7ef80 req-fdb8949e-035c-4f02-bb9e-b14ee74588c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:38.734492 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6250a4f6-776c-490d-b9e1-4af617d7ef80 req-fdb8949e-035c-4f02-bb9e-b14ee74588c3 service neutron] 10.222.0.16 "GET /v2.0/networks?id=73a3dfba-be87-4070-93d2-b14149196c8c HTTP/1.1" status: 200 len: 912 time: 0.7214451 Nov 08 04:11:38.782747 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Allocated IP 172.27.2.48 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/6c26e505-0e98-4171-a6fe-d5c07dd8f748) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:38.800201 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] Set router cb8d019a-2021-4fe7-8fb4-9a6a6883591c gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:11:38.901412 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:39.010226 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6250a4f6-776c-490d-b9e1-4af617d7ef80 req-8e4c1f50-078a-4c9c-86bf-350eb30f7de1 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c8b44127-b903-47ea-98e3-772137eab0f6 HTTP/1.1" status: 200 len: 217 time: 0.1265328 Nov 08 04:11:39.051864 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'Port': ['ID=612109a2-fe18-4eb8-8e67-0167cc19f3eb,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:39.087891 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:39.097584 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-d912722f-9ca9-4ca0-9e87-4bddb226ed81 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 6.5855572 Nov 08 04:11:39.208442 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ea816c5c-f6b1-4f46-8880-287589e6374a req-0b37236f-e713-480f-992a-508da7c3dd10 service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9148765 Nov 08 04:11:39.287343 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:39.296692 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:39.349215 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a477a96f-1447-435b-bbca-970597b925a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:39.351741 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a477a96f-1447-435b-bbca-970597b925a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:39.355059 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a477a96f-1447-435b-bbca-970597b925a8 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/433d2a25-693d-4d75-96ea-22fbbe3475f9 HTTP/1.1" status: 204 len: 168 time: 1.4449871 Nov 08 04:11:39.445151 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:39.445800 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:39.460497 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6250a4f6-776c-490d-b9e1-4af617d7ef80 req-53515734-d6b3-44be-9947-f92ad507fdb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:39.461953 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6250a4f6-776c-490d-b9e1-4af617d7ef80 req-53515734-d6b3-44be-9947-f92ad507fdb8 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=e73cdb7b-96cb-4d2a-bf8a-e10140c5dc14 HTTP/1.1" status: 200 len: 851 time: 0.3918121 Nov 08 04:11:39.482276 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a477a96f-1447-435b-bbca-970597b925a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=433d2a25-693d-4d75-96ea-22fbbe3475f9,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:39.494155 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47c4fba0-8f6d-49c5-8ed8-68f9848ae1e9 req-95125fa0-ba20-4788-8600-599942f95619 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:39.495810 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-47c4fba0-8f6d-49c5-8ed8-68f9848ae1e9 req-95125fa0-ba20-4788-8600-599942f95619 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 943 time: 1.0086327 Nov 08 04:11:39.498449 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ab0eca40-f2f7-4a74-b6c0-6710eb402fbc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:39.501365 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:39.548292 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'Port': ['ID=6c26e505-0e98-4171-a6fe-d5c07dd8f748,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:39.548292 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:39.548292 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:39.562977 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6250a4f6-776c-490d-b9e1-4af617d7ef80 req-20efbaf6-67b0-4c46-bb0e-14cbe38d5c59 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=73a3dfba-be87-4070-93d2-b14149196c8c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0826540 Nov 08 04:11:39.597813 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a346a5-28af-4e2b-a442-ab996a84158b req-0695dee3-625a-4fa0-9005-a8086c68df3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:39.599954 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-95a346a5-28af-4e2b-a442-ab996a84158b req-0695dee3-625a-4fa0-9005-a8086c68df3e service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 1097 time: 0.1678061 Nov 08 04:11:39.618401 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:39.623591 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-router', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8'}], 'enable_snat': True}, 'gw_port_id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:28Z', 'revision_number': 4, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'gw_port': {'id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:8a:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:20Z', 'updated_at': '2021-11-08T04:11:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '551b7e72-649c-47e4-b44e-23c03034da1e', 'name': '', 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'mac_address': 'fa:16:3e:f5:9f:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '900a12a5-1baa-47e1-8b64-245dc70bc9f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:24Z', 'updated_at': '2021-11-08T04:11:37Z', 'revision_number': 4, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'subnets': [{'id': '900a12a5-1baa-47e1-8b64-245dc70bc9f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:11:39.698038 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc244e2-775c-4678-9927-034c074f9970 req-b6d05dc4-e647-40a8-940a-c0d23b5b892e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:39.700114 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-b6d05dc4-e647-40a8-940a-c0d23b5b892e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 819 time: 1.5835736 Nov 08 04:11:39.704143 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ab0eca40-f2f7-4a74-b6c0-6710eb402fbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:39.730428 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d776d8a-1e96-4131-b183-0e60cc8a2593 None None] The sync data for ids ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'] in dv-cinder-783643-4-iscsi is: [{'id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-router', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8'}], 'enable_snat': True}, 'gw_port_id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:28Z', 'revision_number': 4, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'gw_port': {'id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:8a:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:20Z', 'updated_at': '2021-11-08T04:11:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '551b7e72-649c-47e4-b44e-23c03034da1e', 'name': '', 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'mac_address': 'fa:16:3e:f5:9f:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '900a12a5-1baa-47e1-8b64-245dc70bc9f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:24Z', 'updated_at': '2021-11-08T04:11:37Z', 'revision_number': 4, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'subnets': [{'id': '900a12a5-1baa-47e1-8b64-245dc70bc9f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:11:39.844697 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-47c4fba0-8f6d-49c5-8ed8-68f9848ae1e9 req-68917e75-10af-4a66-bcf8-fa1acafa3ebc tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3242404 Nov 08 04:11:40.005746 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-57791609-a614-40f9-9b0d-a5bb3f48e402 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/quotas/e9678ed98e7944babc4f6af7fb368440 HTTP/1.1" status: 200 len: 375 time: 0.2435963 Nov 08 04:11:40.037039 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ab0eca40-f2f7-4a74-b6c0-6710eb402fbc admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=31512e716c5043bab21295efa9a3e8fe&name=default HTTP/1.1" status: 200 len: 2996 time: 2.3140237 Nov 08 04:11:40.064654 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 49564) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:40.084706 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab0eca40-f2f7-4a74-b6c0-6710eb402fbc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c8ba13f2-2bdf-40be-a885-6415bdba603d,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:40.203755 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6250a4f6-776c-490d-b9e1-4af617d7ef80 req-397da04f-9d90-47ad-bf87-7eb0852f9f3e service neutron] 10.222.0.16 "GET /v2.0/networks/73a3dfba-be87-4070-93d2-b14149196c8c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5336444 Nov 08 04:11:40.206987 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:40.236870 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-d25dd813-d8b6-47b1-94fc-528e02b6c4e6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2132599 Nov 08 04:11:40.262395 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a346a5-28af-4e2b-a442-ab996a84158b req-012393a3-24f8-4b76-bf1f-e6ffee6b7e36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:40.264311 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-95a346a5-28af-4e2b-a442-ab996a84158b req-012393a3-24f8-4b76-bf1f-e6ffee6b7e36 service neutron] 10.222.0.16 "GET /v2.0/networks?id=1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 200 len: 915 time: 0.6217573 Nov 08 04:11:40.426705 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-95a346a5-28af-4e2b-a442-ab996a84158b req-5985a7dc-81db-4e97-ba76-37bd187ae0b7 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f790fbae-e681-4e01-b1a4-67513d491300 HTTP/1.1" status: 200 len: 217 time: 0.1357644 Nov 08 04:11:40.595710 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f297209e-47f1-4490-ba94-71b0b93f88d5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:40.666989 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-7d08f56c-2798-4094-a673-d2a3e30e3220 service neutron] 10.222.0.21 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4119768 Nov 08 04:11:40.675577 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:40.821571 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a346a5-28af-4e2b-a442-ab996a84158b req-61495013-c3b0-457e-af19-1cfa70e37231 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:40.821571 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-95a346a5-28af-4e2b-a442-ab996a84158b req-61495013-c3b0-457e-af19-1cfa70e37231 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=59ccbcae-2516-4cc7-9077-478845e3e1f2 HTTP/1.1" status: 200 len: 854 time: 0.2151911 Nov 08 04:11:40.823176 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f947a2f3-eeac-4b3d-938f-5f7fcbfdceb5 req-bfcc12ff-ed51-4986-b5bc-d99f8bea835b tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:40.823176 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f947a2f3-eeac-4b3d-938f-5f7fcbfdceb5 req-bfcc12ff-ed51-4986-b5bc-d99f8bea835b tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 944 time: 0.6578324 Nov 08 04:11:40.823610 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-95a346a5-28af-4e2b-a442-ab996a84158b req-85765bf1-0b58-40b8-a07e-1e6b3eb617b0 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1516eeae-19de-448e-9ebd-952b54f99dcc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0331941 Nov 08 04:11:40.823803 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f297209e-47f1-4490-ba94-71b0b93f88d5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:40.823803 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6250a4f6-776c-490d-b9e1-4af617d7ef80 req-197d3f66-f53e-4913-9cc4-7c176c732347 service neutron] 10.222.0.16 "GET /v2.0/networks/73a3dfba-be87-4070-93d2-b14149196c8c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5647452 Nov 08 04:11:40.879304 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-95a346a5-28af-4e2b-a442-ab996a84158b req-6f9b3fae-9354-450a-a2c9-3d02b0d65d83 service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1195266 Nov 08 04:11:40.964761 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:40.980395 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:40.992262 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f947a2f3-eeac-4b3d-938f-5f7fcbfdceb5 req-ed4504af-0d84-491e-95af-d544eec383a4 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2274234 Nov 08 04:11:41.004996 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f297209e-47f1-4490-ba94-71b0b93f88d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:41.034157 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f297209e-47f1-4490-ba94-71b0b93f88d5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:41.035451 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f297209e-47f1-4490-ba94-71b0b93f88d5 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/c8ba13f2-2bdf-40be-a885-6415bdba603d HTTP/1.1" status: 204 len: 168 time: 0.9517453 Nov 08 04:11:41.107466 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 551b7e72-649c-47e4-b44e-23c03034da1e up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:41.140767 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f297209e-47f1-4490-ba94-71b0b93f88d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8ba13f2-2bdf-40be-a885-6415bdba603d,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:41.194329 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-f2404e59-5625-4d82-844d-7aa07c8ff484 service neutron] 10.222.0.21 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4935861 Nov 08 04:11:41.205672 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'Port': ['ID=6c26e505-0e98-4171-a6fe-d5c07dd8f748,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:41.339776 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 551b7e72-649c-47e4-b44e-23c03034da1e triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:41.343079 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:41.343239 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-95a346a5-28af-4e2b-a442-ab996a84158b req-94cf0fe7-ba7a-411c-bf50-9aed8e7a6aff service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1864033 Nov 08 04:11:41.406633 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:41.418407 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-de8bdc21-9f8e-42b3-8ce8-1d57947b408c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.3978968 Nov 08 04:11:41.429196 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-ebf6eea3-0aa3-404d-ac04-1457da48aaa9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?name=tempest-securitygroup--613512398&fields=id&tenant_id=0efb8c7b359746668b199d14191e3f09 HTTP/1.1" status: 200 len: 267 time: 0.2683420 Nov 08 04:11:41.542437 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:41.635381 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port 551b7e72-649c-47e4-b44e-23c03034da1e, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=551b7e72-649c-47e4-b44e-23c03034da1e,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:41.698258 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:41.765097 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-1bf032da-12a1-4c69-be99-349acf0761b5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:41.767981 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-1bf032da-12a1-4c69-be99-349acf0761b5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.16 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 819 time: 0.4919081 Nov 08 04:11:41.831470 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Request body: {'port': {'device_id': '6ac78e1d-3043-41a2-9a5d-08f026444d81', 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8', 'admin_state_up': True, 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:41.891903 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=551b7e72-649c-47e4-b44e-23c03034da1e,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:41.973804 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3ff12b-6322-42b7-8dd0-eaed54e9682c req-7780e2d4-6d69-42d8-be76-47af76bdde12 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:41.973804 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1a3ff12b-6322-42b7-8dd0-eaed54e9682c req-7780e2d4-6d69-42d8-be76-47af76bdde12 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 943 time: 0.2744253 Nov 08 04:11:41.973804 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-66caa037-1111-41f1-af82-107d85cf321c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:41.973804 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-66caa037-1111-41f1-af82-107d85cf321c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 817 time: 0.4978290 Nov 08 04:11:42.068346 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-4744214e-8e01-460a-be8c-7daab87d3c4e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/quotas/0efb8c7b359746668b199d14191e3f09 HTTP/1.1" status: 200 len: 375 time: 0.0708158 Nov 08 04:11:42.123866 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1a3ff12b-6322-42b7-8dd0-eaed54e9682c req-f5f07ed4-f56e-4d14-98a0-10cd28504b88 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1629927 Nov 08 04:11:42.189999 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-be40348e-2866-4d72-b19e-5359a5d4e1c8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1094918 Nov 08 04:11:42.251005 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-61b217c3-770f-4d92-ab4a-9126b651b649 req-d57b28b9-4abf-4da2-8074-d87d41c4c43f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 210 time: 0.0426850 Nov 08 04:11:42.425040 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Made reservation on behalf of e9678ed98e7944babc4f6af7fb368440 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:42.425040 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:42.427260 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49642) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:42.495522 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4a32ebaf-5051-4200-91f4-35b839acb9e3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:42.550400 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-9204c241-06c8-4191-a3e7-9e61c0a28acb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?name=tempest-securitygroup--1828984374&fields=id&tenant_id=ebd67f9cc3964c7bbc45974e8833edd2 HTTP/1.1" status: 200 len: 267 time: 0.1735508 Nov 08 04:11:42.638719 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-ce22baec-0225-4bec-adf0-c5052ac521e6 service neutron] 10.222.0.21 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3854246 Nov 08 04:11:42.671987 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a7c88c76-df40-47fc-9656-5a39afc77553 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:42.693563 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4a32ebaf-5051-4200-91f4-35b839acb9e3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:42.761437 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4a32ebaf-5051-4200-91f4-35b839acb9e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:42.864144 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a32ebaf-5051-4200-91f4-35b839acb9e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5acd385-8a2d-4082-a309-0615325ed285,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:42.907585 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Allocated IP 172.20.0.9 (8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8/900a12a5-1baa-47e1-8b64-245dc70bc9f2/4bc6cc8c-782d-4718-85b4-81156f4a2000) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:42.907788 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-4a32ebaf-5051-4200-91f4-35b839acb9e3 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=a963e13a27a942749cc5d9f67bda7c6c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4765825 Nov 08 04:11:42.908487 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49660) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:42.945230 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea11211-2367-467d-bbbc-14584cb77159 req-ca393143-30ba-4c34-8779-f8b26ac14622 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:42.952398 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-ca393143-30ba-4c34-8779-f8b26ac14622 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/networks?id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f HTTP/1.1" status: 200 len: 811 time: 0.4010794 Nov 08 04:11:42.971458 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-e9fd2e77-403c-405f-9004-4b86d280d96b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/quotas/ebd67f9cc3964c7bbc45974e8833edd2 HTTP/1.1" status: 200 len: 375 time: 0.0180776 Nov 08 04:11:42.978371 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-f77c4d7f-2617-4ccd-92ae-729146fc4e41 service neutron] 10.222.0.21 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3340926 Nov 08 04:11:43.039483 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-571e10e2-3895-4a18-a8cd-d42251b58d4c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:43.058007 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 551b7e72-649c-47e4-b44e-23c03034da1e up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:43.075447 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-571e10e2-3895-4a18-a8cd-d42251b58d4c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:43.168501 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 551b7e72-649c-47e4-b44e-23c03034da1e triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:43.175649 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:43.260290 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-571e10e2-3895-4a18-a8cd-d42251b58d4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:43.272592 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-571e10e2-3895-4a18-a8cd-d42251b58d4c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:43.272592 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-571e10e2-3895-4a18-a8cd-d42251b58d4c admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/d5acd385-8a2d-4082-a309-0615325ed285 HTTP/1.1" status: 204 len: 168 time: 0.3427951 Nov 08 04:11:43.287331 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-571e10e2-3895-4a18-a8cd-d42251b58d4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5acd385-8a2d-4082-a309-0615325ed285,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:43.348345 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-5c8678d7-d041-40bb-a9f5-2ebe6b3cd193 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&fields=id HTTP/1.1" status: 200 len: 348 time: 0.3444409 Nov 08 04:11:43.348839 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:43.518264 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:43.609915 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:43.628747 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-483917cd-631b-46c9-b3e3-fa9b8f237c5c service neutron] 10.222.0.21 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2188549 Nov 08 04:11:43.629003 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ecdb8c2-733b-442a-8565-d8224df0291a req-68adce79-2871-48d2-ac80-cd360225791d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:43.630666 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ecdb8c2-733b-442a-8565-d8224df0291a req-68adce79-2871-48d2-ac80-cd360225791d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 944 time: 0.1570902 Nov 08 04:11:43.631626 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:43.646812 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:43.652502 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:43.653027 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:43.661623 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Pushing event updated for resources: {'Port': ['ID=4bc6cc8c-782d-4718-85b4-81156f4a2000,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:43.767278 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ecdb8c2-733b-442a-8565-d8224df0291a req-8d528682-8bee-4a0e-ab4c-77b8ac0004f7 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1103921 Nov 08 04:11:43.795299 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-02b921c1-f8db-47d7-9823-c8f73168d791 service neutron] 10.222.0.21 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1591082 Nov 08 04:11:44.077541 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-6d59e5bf-97b2-4e2b-8d41-883e55c877c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2772634 Nov 08 04:11:44.088997 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43365900-344d-4136-ba66-396f0a02d65e req-fb72bfc1-8a58-496d-8d8b-6690298942f4 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:44.096377 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43365900-344d-4136-ba66-396f0a02d65e req-fb72bfc1-8a58-496d-8d8b-6690298942f4 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 943 time: 0.2692285 Nov 08 04:11:44.115686 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Request body: {'port': {'device_id': '6ac78e1d-3043-41a2-9a5d-08f026444d81', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:44.233079 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-82a46f70-bc9f-412b-8070-7284c053c451 req-2d487a29-219c-4995-bc70-7ebfa86af1b3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 210 time: 0.0640302 Nov 08 04:11:44.233690 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:44.251826 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43365900-344d-4136-ba66-396f0a02d65e req-89ec2065-103c-4f1a-b8b9-ccc9147e2ec5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1391342 Nov 08 04:11:44.395548 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-68eb88d6-2621-47db-9db1-568c57c1a9aa req-1a0565a1-8ca4-4ce8-9d55-827f60d8692d tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 210 time: 0.0564253 Nov 08 04:11:44.440712 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f472eb64-fb78-41b4-8fd8-18922b581d8d req-48291f1f-fc76-479e-ae0c-2ad10d33eec8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 210 time: 0.0997574 Nov 08 04:11:44.650879 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4bc6cc8c-782d-4718-85b4-81156f4a2000 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:44.658114 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:44.670430 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Transition to ACTIVE for port object 4bc6cc8c-782d-4718-85b4-81156f4a2000 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:11:44.762836 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:44.856339 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Pushing event updated for resources: {'Port': ['ID=4bc6cc8c-782d-4718-85b4-81156f4a2000,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:44.878810 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Attempting to bind port 4bc6cc8c-782d-4718-85b4-81156f4a2000 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:44.879189 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Attempting to bind port 4bc6cc8c-782d-4718-85b4-81156f4a2000 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:44.890699 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Attempting to bind port 4bc6cc8c-782d-4718-85b4-81156f4a2000 on network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:44.890699 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Port 4bc6cc8c-782d-4718-85b4-81156f4a2000 on network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:11:44.890699 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Attempting to bind port 4bc6cc8c-782d-4718-85b4-81156f4a2000 on network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:44.892707 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:44.893959 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Checking segment: {'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:44.894369 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Bound using segment: {'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:44.894833 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Bound port: 4bc6cc8c-782d-4718-85b4-81156f4a2000, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:44.895185 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:45.005449 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cc4e9d3-27b1-4fb6-b6dd-11d85fe44dc4 req-765403c6-ef02-4165-ab91-4c1f9e6ec733 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:45.006943 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6cc4e9d3-27b1-4fb6-b6dd-11d85fe44dc4 req-765403c6-ef02-4165-ab91-4c1f9e6ec733 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 944 time: 0.0857644 Nov 08 04:11:45.009385 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] For port 4bc6cc8c-782d-4718-85b4-81156f4a2000, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:45.013055 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] For port 4bc6cc8c-782d-4718-85b4-81156f4a2000, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:45.091149 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6cc4e9d3-27b1-4fb6-b6dd-11d85fe44dc4 req-82543893-7fd9-4700-9644-5fb022e3c0d5 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692339 Nov 08 04:11:45.123518 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:45.160235 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:45.167721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:45.167721 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] 10.222.0.16 "PUT /v2.0/ports/4bc6cc8c-782d-4718-85b4-81156f4a2000 HTTP/1.1" status: 200 len: 1093 time: 1.0538251 Nov 08 04:11:45.167721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6ac78e1d-3043-41a2-9a5d-08f026444d81', 'tag': '4bc6cc8c-782d-4718-85b4-81156f4a2000'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:11:45.167721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9a30066-baba-45ea-990e-b372e37ef3fa" -d '{"events": [{"name": "network-changed", "server_uuid": "6ac78e1d-3043-41a2-9a5d-08f026444d81", "tag": "4bc6cc8c-782d-4718-85b4-81156f4a2000"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:11:45.186075 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-56abeb65-caad-4eec-b3f9-93cf708c3099 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:45.240604 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:11:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32051ea7-513e-4e9a-8e67-e8859985bba8 x-openstack-request-id: req-32051ea7-513e-4e9a-8e67-e8859985bba8 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:11:45.241113 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6ac78e1d-3043-41a2-9a5d-08f026444d81", "tag": "4bc6cc8c-782d-4718-85b4-81156f4a2000", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:11:45.241518 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-32051ea7-513e-4e9a-8e67-e8859985bba8 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:11:45.242100 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6ac78e1d-3043-41a2-9a5d-08f026444d81', 'tag': '4bc6cc8c-782d-4718-85b4-81156f4a2000', 'status': 'completed', 'code': 200} Nov 08 04:11:45.243294 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d77b119-9252-4af3-9f32-e1f94d470ebe service neutron] Pushing event updated for resources: {'Port': ['ID=4bc6cc8c-782d-4718-85b4-81156f4a2000,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:45.335687 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc244e2-775c-4678-9927-034c074f9970 req-8f48d8b9-6932-4765-a839-e5d4b0db1626 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:45.339316 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-8f48d8b9-6932-4765-a839-e5d4b0db1626 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.16 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 819 time: 0.2238314 Nov 08 04:11:45.360174 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Request body: {'port': {'device_id': '63ce1fee-21b7-44fe-8e44-78d58a2f9174', 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8', 'admin_state_up': True, 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:45.381465 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc34190d-a409-41d0-a56b-3faf38858f30 req-007fd122-819b-4439-972c-5b3836659b10 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 210 time: 0.0338345 Nov 08 04:11:45.433941 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9a30066-baba-45ea-990e-b372e37ef3fa req-1bdf849b-47e0-4d28-b235-52f24e5e5488 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:45.435481 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a9a30066-baba-45ea-990e-b372e37ef3fa req-1bdf849b-47e0-4d28-b235-52f24e5e5488 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 1096 time: 0.1221571 Nov 08 04:11:45.457631 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d976a1-4e42-4695-8c67-624a4fdb79f9 req-529a4506-c023-430b-9dcb-cf5232d7105b tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:45.459728 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06d976a1-4e42-4695-8c67-624a4fdb79f9 req-529a4506-c023-430b-9dcb-cf5232d7105b tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 943 time: 0.0826705 Nov 08 04:11:45.561242 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6e180cc0-7814-40e1-a432-3f25ca7ff495 req-a3ee1078-7271-4ceb-bbb0-d088448a84d0 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 210 time: 0.0678813 Nov 08 04:11:45.607215 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Made reservation on behalf of e9678ed98e7944babc4f6af7fb368440 for: {'port': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:45.612670 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:45.637866 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06d976a1-4e42-4695-8c67-624a4fdb79f9 req-2587f285-56a2-4d0a-b5e0-f0ece2059e4b tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1612558 Nov 08 04:11:45.762611 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cbf909ee-e762-470b-aa9a-f12cbf4d5a36 req-5370ee40-5455-4dfb-a2cc-c2143aab3652 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 210 time: 0.0396202 Nov 08 04:11:45.766000 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9a30066-baba-45ea-990e-b372e37ef3fa req-aa230251-eab5-4c9d-9df2-4655db0abec0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:45.767619 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a9a30066-baba-45ea-990e-b372e37ef3fa req-aa230251-eab5-4c9d-9df2-4655db0abec0 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=e9678ed98e7944babc4f6af7fb368440&shared=False HTTP/1.1" status: 200 len: 920 time: 0.3072798 Nov 08 04:11:45.834545 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Allocated IP 172.20.0.8 (8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8/900a12a5-1baa-47e1-8b64-245dc70bc9f2/4e88411d-7ee7-4112-84b9-3f6a87ffd8e6) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:45.990714 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9a30066-baba-45ea-990e-b372e37ef3fa req-61f3d079-0182-4dd6-b5c1-7bcba3417536 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:45.990714 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a9a30066-baba-45ea-990e-b372e37ef3fa req-61f3d079-0182-4dd6-b5c1-7bcba3417536 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1916680 Nov 08 04:11:45.990943 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:46.023414 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:46.102560 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-ad4261a9-b558-4ac3-bd0b-0b0f6f85b749 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:46.104546 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-ad4261a9-b558-4ac3-bd0b-0b0f6f85b749 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 1096 time: 0.0515447 Nov 08 04:11:46.145352 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:46.165986 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-c45a254d-9594-472a-8673-c689cfe17756 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000 HTTP/1.1" status: 200 len: 217 time: 0.0457518 Nov 08 04:11:46.233994 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:46.237821 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:46.242856 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:46.249423 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:46.250125 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:46.262006 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Pushing event updated for resources: {'Port': ['ID=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:46.275899 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-d8025c9c-a9c7-4d00-ac33-1230073c6bf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:46.277489 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-d8025c9c-a9c7-4d00-ac33-1230073c6bf3 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=900a12a5-1baa-47e1-8b64-245dc70bc9f2 HTTP/1.1" status: 200 len: 859 time: 0.1032789 Nov 08 04:11:46.317315 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-5b1f7c93-ede6-4cdc-9bee-a45411477209 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0315676 Nov 08 04:11:46.340824 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069f52e4-9395-4890-b59a-fc9998bdade8 req-ee5bd3af-97c9-49c7-9923-aac25f69a29a tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:46.340824 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-069f52e4-9395-4890-b59a-fc9998bdade8 req-ee5bd3af-97c9-49c7-9923-aac25f69a29a tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 944 time: 0.1232431 Nov 08 04:11:46.397828 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-3da6dead-09cf-4893-9ce7-0f70ceea30b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0435016 Nov 08 04:11:46.417949 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Request body: {'port': {'device_id': '63ce1fee-21b7-44fe-8e44-78d58a2f9174', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:46.448512 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-069f52e4-9395-4890-b59a-fc9998bdade8 req-2b57f189-f38c-4b81-ba00-e0c0d3d1b2bd tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1017206 Nov 08 04:11:46.469791 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.16', 51233) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:46.483317 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-c329ac34-74f0-4e5a-953f-cb990f5e83a6 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1438291 Nov 08 04:11:46.633547 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00a8680-23a6-4a72-bd09-8588e29d9687 req-3676e409-87a9-4d8a-a3df-6af4d17c648d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:46.635200 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e00a8680-23a6-4a72-bd09-8588e29d9687 req-3676e409-87a9-4d8a-a3df-6af4d17c648d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 931 time: 0.1275451 Nov 08 04:11:46.702282 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-39368cd1-1f40-4521-82f7-2ec2f3460f61 req-4f4b1410-0b4e-49c7-b689-ec960ba2c430 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 210 time: 0.0522194 Nov 08 04:11:46.704120 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de8d57a3-bf80-4bc5-8dc2-9d92812f2cd1 req-c45b7386-7798-4842-b2d8-4afbb43b33f9 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2043927 Nov 08 04:11:46.735715 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:46.741175 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device f790fbae-e681-4e01-b1a4-67513d491300 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:11:46.741948 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e00a8680-23a6-4a72-bd09-8588e29d9687 req-edcda4a0-5b5c-47ff-8324-68889f503b20 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0997207 Nov 08 04:11:46.894616 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-b5af7a0c-67bc-4551-aed4-c14951b0c19d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:46.894616 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-b5af7a0c-67bc-4551-aed4-c14951b0c19d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 817 time: 0.4175959 Nov 08 04:11:46.896136 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port f790fbae-e681-4e01-b1a4-67513d491300, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=f790fbae-e681-4e01-b1a4-67513d491300,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:46.909414 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'f790fbae-e681-4e01-b1a4-67513d491300', 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc', 'port_id': 'f790fbae-e681-4e01-b1a4-67513d491300', 'mac_address': 'fa:16:3e:ff:f2:a6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59ccbcae-2516-4cc7-9077-478845e3e1f2', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:11:46.966061 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d5165460-aa7a-4bf0-b212-a6152f0d3489 req-d9d2890f-5ba0-4e99-920b-9eb2a4d5bdeb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 210 time: 0.0770297 Nov 08 04:11:46.979649 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:46.984061 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7768a632-c186-4b87-b861-2b239fcb2947 req-297dc7df-ed6e-4f6f-9548-3de51e717798 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:46.986135 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7768a632-c186-4b87-b861-2b239fcb2947 req-297dc7df-ed6e-4f6f-9548-3de51e717798 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 943 time: 0.1509733 Nov 08 04:11:46.997168 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f790fbae-e681-4e01-b1a4-67513d491300 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:47.022935 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port f790fbae-e681-4e01-b1a4-67513d491300, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=f790fbae-e681-4e01-b1a4-67513d491300,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:47.050985 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7768a632-c186-4b87-b861-2b239fcb2947 req-5459400b-bf3d-4ff3-9e3c-faed78d2f5f7 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459726 Nov 08 04:11:47.054814 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-adc35ea8-1344-4be1-a494-bb2bf2aac2f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0efb8c7b359746668b199d14191e3f09 HTTP/1.1" status: 200 len: 379 time: 0.1102457 Nov 08 04:11:47.084977 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'port': {'device_id': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'admin_state_up': True, 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'security_groups': ['5301efbc-e522-4603-b20e-2d3c40cd69c5']}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:47.122864 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.123654 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device c8b44127-b903-47ea-98e3-772137eab0f6 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:11:47.200496 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=f790fbae-e681-4e01-b1a4-67513d491300,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:47.269608 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port c8b44127-b903-47ea-98e3-772137eab0f6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=c8b44127-b903-47ea-98e3-772137eab0f6,segment=NetworkSegment(40c10b14-9bad-4182-9d99-8cce48b6c4f8),segment_id=40c10b14-9bad-4182-9d99-8cce48b6c4f8)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:47.277416 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 {{(pid=101664) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:47.283693 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'c8b44127-b903-47ea-98e3-772137eab0f6', 'network_id': '73a3dfba-be87-4070-93d2-b14149196c8c', 'port_id': 'c8b44127-b903-47ea-98e3-772137eab0f6', 'mac_address': 'fa:16:3e:de:c9:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 152, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e73cdb7b-96cb-4d2a-bf8a-e10140c5dc14', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:11:47.285356 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.300849 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.provisioning_blocks [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Transition to ACTIVE for port object 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 will not be triggered until provisioned by entity L2. {{(pid=101664) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:11:47.321777 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.342993 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c8b44127-b903-47ea-98e3-772137eab0f6 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:47.357894 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Made reservation on behalf of 0efb8c7b359746668b199d14191e3f09 for: {'port': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:47.365067 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port c8b44127-b903-47ea-98e3-772137eab0f6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=c8b44127-b903-47ea-98e3-772137eab0f6,segment=NetworkSegment(40c10b14-9bad-4182-9d99-8cce48b6c4f8),segment_id=40c10b14-9bad-4182-9d99-8cce48b6c4f8)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:47.374848 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.434698 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.438142 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.522298 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=c8b44127-b903-47ea-98e3-772137eab0f6,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:47.554584 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Pushing event updated for resources: {'Port': ['ID=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:47.575715 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Attempting to bind port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:47.576417 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Attempting to bind port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'}] {{(pid=101664) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:47.576946 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Attempting to bind port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 on network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:47.598708 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 on network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:11:47.598708 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Attempting to bind port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 on network 8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:47.608739 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:47.609221 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Checking segment: {'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:47.609769 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Bound using segment: {'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'} {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:47.610783 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Bound port: 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f7e22fd-7d1a-479e-9785-43712201ed49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 170, 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8'}}] {{(pid=101664) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:47.610783 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.624970 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Allocated IP 172.20.0.3 (6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e/20a91346-16ed-4174-9e29-b85a8dc77939/e6483e56-c377-4575-bd34-b26a5c2bf382) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:47.655218 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.710840 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea11211-2367-467d-bbbc-14584cb77159 req-47f9d8e8-ecf2-4176-94b0-93436fea966f tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:47.711396 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] For port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6, host hv-cinder-78364, cleared binding levels {{(pid=101664) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:47.712369 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-47f9d8e8-ecf2-4176-94b0-93436fea966f tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.16 "GET /v2.0/networks?id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f HTTP/1.1" status: 200 len: 811 time: 0.4458261 Nov 08 04:11:47.739396 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] For port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101664) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:47.742912 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c7ba38-d0f2-4b97-9f03-2a6a017d52fe req-c31467f8-ea34-4194-af01-4306d8d89d6e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:47.745036 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-49c7ba38-d0f2-4b97-9f03-2a6a017d52fe req-c31467f8-ea34-4194-af01-4306d8d89d6e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 945 time: 0.0988746 Nov 08 04:11:47.809412 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.840942 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-54005b2d-c75d-4b37-8aee-6fe7eda73e93 req-dba4d2c9-1c0d-4f25-9a48-657cbfb9ea9d tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 210 time: 0.0430145 Nov 08 04:11:47.866125 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.868665 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['c8b44127-b903-47ea-98e3-772137eab0f6'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:11:47.877053 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-47ed74be-bbea-48d3-8b55-0a02e0d73ded tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ebd67f9cc3964c7bbc45974e8833edd2 HTTP/1.1" status: 200 len: 380 time: 0.1496384 Nov 08 04:11:47.879066 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:47.880191 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:47.881931 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] 10.222.0.16 "PUT /v2.0/ports/4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 HTTP/1.1" status: 200 len: 1093 time: 1.4691150 Nov 08 04:11:47.884552 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '63ce1fee-21b7-44fe-8e44-78d58a2f9174', 'tag': '4e88411d-7ee7-4112-84b9-3f6a87ffd8e6'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:11:47.887262 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c72cb386-e932-47ac-8562-78a7c5a0d8a3" -d '{"events": [{"name": "network-changed", "server_uuid": "63ce1fee-21b7-44fe-8e44-78d58a2f9174", "tag": "4e88411d-7ee7-4112-84b9-3f6a87ffd8e6"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:11:47.914110 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13df2fb0-8fed-46c9-a25e-2197de7e5d07 service neutron] Pushing event updated for resources: {'Port': ['ID=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,revision_number=3']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:47.914491 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-49c7ba38-d0f2-4b97-9f03-2a6a017d52fe req-6deb4a66-2b85-4c98-8844-b65b83e2e3e2 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1351869 Nov 08 04:11:47.925574 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'port': {'device_id': '12c1d323-bd37-4a14-be65-7a504c81950a', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'admin_state_up': True, 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'security_groups': ['6e7fcf69-0275-47ef-809e-470976ce212d']}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:47.939523 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['f790fbae-e681-4e01-b1a4-67513d491300'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:11:47.972579 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:11:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8555d2b3-3181-44fd-a4bc-0275c30d8a79 x-openstack-request-id: req-8555d2b3-3181-44fd-a4bc-0275c30d8a79 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:11:47.972876 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "63ce1fee-21b7-44fe-8e44-78d58a2f9174", "tag": "4e88411d-7ee7-4112-84b9-3f6a87ffd8e6", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:11:47.973129 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-8555d2b3-3181-44fd-a4bc-0275c30d8a79 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:11:47.973538 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '63ce1fee-21b7-44fe-8e44-78d58a2f9174', 'tag': '4e88411d-7ee7-4112-84b9-3f6a87ffd8e6', 'status': 'completed', 'code': 200} Nov 08 04:11:48.010878 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.111946 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:48.144328 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:48.163884 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f03b292-864c-48bd-92ff-f23b577a51c8 req-578eee43-ee86-4492-bde7-8cdc373c573d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:48.172644 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f03b292-864c-48bd-92ff-f23b577a51c8 req-578eee43-ee86-4492-bde7-8cdc373c573d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 943 time: 0.1953156 Nov 08 04:11:48.174392 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:48.187374 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:48.189758 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.204258 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71eb5b2c-5730-4ea8-9081-3d0781d00ed5 req-9778565a-87f3-43e3-bfc8-c184cc554cb2 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:48.213969 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-71eb5b2c-5730-4ea8-9081-3d0781d00ed5 req-9778565a-87f3-43e3-bfc8-c184cc554cb2 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 931 time: 0.1315227 Nov 08 04:11:48.234229 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49830) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:48.240967 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:48.252961 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c72cb386-e932-47ac-8562-78a7c5a0d8a3 req-2d35132a-6d13-4e55-93c0-c9450144a1b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:48.253401 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-c72cb386-e932-47ac-8562-78a7c5a0d8a3 req-2d35132a-6d13-4e55-93c0-c9450144a1b8 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 1096 time: 0.1992068 Nov 08 04:11:48.269213 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Made reservation on behalf of ebd67f9cc3964c7bbc45974e8833edd2 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:11:48.275095 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.316079 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-2d6bc73e-f6db-4eab-9c7e-f3cc2f922a06 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2348244 Nov 08 04:11:48.369679 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Request body: {'port': {'device_id': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:48.370580 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-71eb5b2c-5730-4ea8-9081-3d0781d00ed5 req-7ebb581a-04e6-4c5d-9845-0a7e87f0896b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1467311 Nov 08 04:11:48.430141 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f03b292-864c-48bd-92ff-f23b577a51c8 req-92a4e10c-542d-4de1-a31e-bbfb73955570 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2559934 Nov 08 04:11:48.458598 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c0942ac9-a3d3-41fc-86a0-1ab86fce9067 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.461051 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-c863d74c-970e-4a39-b4b7-75731ef4b44b None None] Provisioning complete for port e6483e56-c377-4575-bd34-b26a5c2bf382 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:48.461427 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c863d74c-970e-4a39-b4b7-75731ef4b44b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.499335 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-c863d74c-970e-4a39-b4b7-75731ef4b44b None None] Port e6483e56-c377-4575-bd34-b26a5c2bf382 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:11:48.529923 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.548390 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ae99b4-7f8f-4d2b-80be-236c0e14768c req-f8520a3d-0f2a-4b86-a6ae-644428b06955 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:48.549876 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c6ae99b4-7f8f-4d2b-80be-236c0e14768c req-f8520a3d-0f2a-4b86-a6ae-644428b06955 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 944 time: 0.0889356 Nov 08 04:11:48.564937 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Allocated IP 172.20.0.9 (bd0479b2-da8e-41bd-929c-b9ece4aaa29f/1158e941-c129-49d0-9b8b-ba72d0ef6717/d997f4bb-f698-4538-b9ae-f08bec1d6ff6) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:11:48.581286 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.586094 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c72cb386-e932-47ac-8562-78a7c5a0d8a3 req-2c46b9e4-daa0-4daf-9b96-91c43b2b84dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:48.588353 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-c72cb386-e932-47ac-8562-78a7c5a0d8a3 req-2c46b9e4-daa0-4daf-9b96-91c43b2b84dc service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=e9678ed98e7944babc4f6af7fb368440&shared=False HTTP/1.1" status: 200 len: 920 time: 0.3212094 Nov 08 04:11:48.625051 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c6ae99b4-7f8f-4d2b-80be-236c0e14768c req-dc39ee68-0d4c-4c42-ae66-834450a4b9d8 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688317 Nov 08 04:11:48.746545 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device f790fbae-e681-4e01-b1a4-67513d491300 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:48.781417 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.870151 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c0942ac9-a3d3-41fc-86a0-1ab86fce9067 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.887232 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port f790fbae-e681-4e01-b1a4-67513d491300 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:11:48.890357 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c72cb386-e932-47ac-8562-78a7c5a0d8a3 req-d29be7ef-14e1-45e7-b75e-dec9eba79fbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:48.891868 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-c72cb386-e932-47ac-8562-78a7c5a0d8a3 req-d29be7ef-14e1-45e7-b75e-dec9eba79fbe service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2936382 Nov 08 04:11:48.900083 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port f790fbae-e681-4e01-b1a4-67513d491300 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:48.900447 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.903430 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.936089 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c0942ac9-a3d3-41fc-86a0-1ab86fce9067 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:48.998593 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'Port': ['ID=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:49.047276 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.069960 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Network bd0479b2-da8e-41bd-929c-b9ece4aaa29f is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:11:49.074980 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dda4312d-16a9-4d15-9482-a296b62c88c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f790fbae-e681-4e01-b1a4-67513d491300'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:11:49.076462 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:11:49.080420 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:11:49.092845 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:49.092971 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.124479 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b43877ed-4c35-45f3-927b-edb1dbdef813 req-6ca45267-53a3-4f09-ae7d-10351d4b35a9 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:49.126135 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b43877ed-4c35-45f3-927b-edb1dbdef813 req-6ca45267-53a3-4f09-ae7d-10351d4b35a9 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 931 time: 0.1486492 Nov 08 04:11:49.140674 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcbe62c8-e6b1-451b-a748-036f91cb671a req-0ccc6ad8-6e6a-4f45-944a-74cc6cfc66cb tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:49.142167 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bcbe62c8-e6b1-451b-a748-036f91cb671a req-0ccc6ad8-6e6a-4f45-944a-74cc6cfc66cb tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 945 time: 0.1117122 Nov 08 04:11:49.182130 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port f790fbae-e681-4e01-b1a4-67513d491300, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=f790fbae-e681-4e01-b1a4-67513d491300,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:49.206343 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-adb418ba-ff4d-45ea-ad00-c21f1718fffc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2907445 Nov 08 04:11:49.225122 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b43877ed-4c35-45f3-927b-edb1dbdef813 req-3420325d-8d89-4771-82c0-d6b01cac9eb8 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0818796 Nov 08 04:11:49.238251 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-c0942ac9-a3d3-41fc-86a0-1ab86fce9067 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=5ca3fc1897054c0aa46eec82d5a20fd9&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0029447 Nov 08 04:11:49.244617 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49854) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:49.249590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Request body: {'port': {'device_id': '12c1d323-bd37-4a14-be65-7a504c81950a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:11:49.251178 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0942ac9-a3d3-41fc-86a0-1ab86fce9067 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40b29a3b-8f8c-4040-a710-274be7af6872,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:49.282905 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.284124 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device c8b44127-b903-47ea-98e3-772137eab0f6 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:49.346829 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bcbe62c8-e6b1-451b-a748-036f91cb671a req-8fb19114-e064-42b0-9932-8a11889b76eb tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1792448 Nov 08 04:11:49.365192 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.366307 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc244e2-775c-4678-9927-034c074f9970 req-a13de022-b437-4a81-8592-c3b41be58d67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:49.373565 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-a13de022-b437-4a81-8592-c3b41be58d67 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 1096 time: 0.2489834 Nov 08 04:11:49.396593 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8862d13b-d3c9-4c2e-8c36-e45be87487cc" -d '{"events": [{"server_uuid": "dda4312d-16a9-4d15-9482-a296b62c88c1", "name": "network-vif-plugged", "status": "completed", "tag": "f790fbae-e681-4e01-b1a4-67513d491300"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:11:49.420800 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=f790fbae-e681-4e01-b1a4-67513d491300,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:49.458593 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e6483e56-c377-4575-bd34-b26a5c2bf382 {{(pid=101664) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:49.468518 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-d36c07bd-4483-4463-bed8-1b95d45d26e3 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 HTTP/1.1" status: 200 len: 217 time: 0.0801628 Nov 08 04:11:49.477672 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-456d2370-fcb4-480f-adec-d3fc07ea4320 None None] Provisioning complete for port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:49.477672 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-456d2370-fcb4-480f-adec-d3fc07ea4320 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.485229 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.528587 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-92a3bb86-74fa-4014-b385-e4d4a1de11bc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.562079 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-92a3bb86-74fa-4014-b385-e4d4a1de11bc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.632148 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc244e2-775c-4678-9927-034c074f9970 req-de71952b-9127-4293-a7f9-b8856cf90c00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:49.634168 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-de71952b-9127-4293-a7f9-b8856cf90c00 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=900a12a5-1baa-47e1-8b64-245dc70bc9f2 HTTP/1.1" status: 200 len: 859 time: 0.1519482 Nov 08 04:11:49.678730 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-31fe4af7-b6f6-41a0-b11e-195e15574ecd service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0364003 Nov 08 04:11:49.700806 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:11:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dfadba35-36d2-46d3-9fcf-8c82fc187ae9 x-openstack-request-id: req-dfadba35-36d2-46d3-9fcf-8c82fc187ae9 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:11:49.701117 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dda4312d-16a9-4d15-9482-a296b62c88c1", "name": "network-vif-plugged", "status": "completed", "tag": "f790fbae-e681-4e01-b1a4-67513d491300", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:11:49.701404 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-dfadba35-36d2-46d3-9fcf-8c82fc187ae9 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:11:49.701886 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dda4312d-16a9-4d15-9482-a296b62c88c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f790fbae-e681-4e01-b1a4-67513d491300', 'code': 200} Nov 08 04:11:49.704547 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port c8b44127-b903-47ea-98e3-772137eab0f6 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:11:49.709944 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.provisioning_blocks [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Transition to ACTIVE for port object e6483e56-c377-4575-bd34-b26a5c2bf382 will not be triggered until provisioned by entity L2. {{(pid=101664) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:11:49.713699 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-92a3bb86-74fa-4014-b385-e4d4a1de11bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.713816 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port c8b44127-b903-47ea-98e3-772137eab0f6 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:49.713816 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.716020 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-92a3bb86-74fa-4014-b385-e4d4a1de11bc admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.721121 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-92a3bb86-74fa-4014-b385-e4d4a1de11bc admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/40b29a3b-8f8c-4040-a710-274be7af6872 HTTP/1.1" status: 204 len: 168 time: 0.4647789 Nov 08 04:11:49.729044 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d832c377-2b5a-499d-abe2-684f6b4657b6 req-57d78d32-b641-498e-bc6c-631354ce68b9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:49.730682 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d832c377-2b5a-499d-abe2-684f6b4657b6 req-57d78d32-b641-498e-bc6c-631354ce68b9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 931 time: 0.1704950 Nov 08 04:11:49.742606 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-456d2370-fcb4-480f-adec-d3fc07ea4320 None None] Port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:11:49.786029 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df178658-5e64-482c-9624-e68f7362f7c5 req-02e3dd6f-d94b-4138-a6b0-7fc66c67ce2c tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:49.787718 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df178658-5e64-482c-9624-e68f7362f7c5 req-02e3dd6f-d94b-4138-a6b0-7fc66c67ce2c tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 943 time: 0.1336045 Nov 08 04:11:49.817621 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.829565 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92a3bb86-74fa-4014-b385-e4d4a1de11bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40b29a3b-8f8c-4040-a710-274be7af6872,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:49.835054 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.865055 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d832c377-2b5a-499d-abe2-684f6b4657b6 req-8a13b6cd-c363-4788-b4e7-723f62f98fef tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1057837 Nov 08 04:11:49.892553 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-6756be08-669b-4a60-b3ef-f6c4e9b707be service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2052717 Nov 08 04:11:49.897980 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df178658-5e64-482c-9624-e68f7362f7c5 req-720eafe1-d230-4245-96f2-3801b9b2e7ab tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1033862 Nov 08 04:11:49.899683 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port c8b44127-b903-47ea-98e3-772137eab0f6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=c8b44127-b903-47ea-98e3-772137eab0f6,segment=NetworkSegment(40c10b14-9bad-4182-9d99-8cce48b6c4f8),segment_id=40c10b14-9bad-4182-9d99-8cce48b6c4f8)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:49.967913 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d997f4bb-f698-4538-b9ae-f08bec1d6ff6 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:49.968638 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:49.981772 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.16', 51242) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:49.992745 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.072658 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=c8b44127-b903-47ea-98e3-772137eab0f6,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:50.076849 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Transition to ACTIVE for port object d997f4bb-f698-4538-b9ae-f08bec1d6ff6 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:11:50.095825 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Pushing event updated for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:50.124886 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfef678b-369f-42c9-bd5a-6ed7c6046ca0 req-45843910-cb0d-40f6-a0b1-b5649de174c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:50.126385 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cfef678b-369f-42c9-bd5a-6ed7c6046ca0 req-45843910-cb0d-40f6-a0b1-b5649de174c4 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 1099 time: 0.1435211 Nov 08 04:11:50.138997 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Attempting to bind port e6483e56-c377-4575-bd34-b26a5c2bf382 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:50.139959 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Attempting to bind port e6483e56-c377-4575-bd34-b26a5c2bf382 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'}] {{(pid=101664) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:50.140229 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24e68716-dfaa-446e-8822-7d9d06b334e1 req-66dd889f-8179-4c47-bac8-58b81a6c03e1 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:50.141362 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Attempting to bind port e6483e56-c377-4575-bd34-b26a5c2bf382 on network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:50.141719 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-24e68716-dfaa-446e-8822-7d9d06b334e1 req-66dd889f-8179-4c47-bac8-58b81a6c03e1 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 945 time: 0.0948138 Nov 08 04:11:50.156448 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cfef678b-369f-42c9-bd5a-6ed7c6046ca0 req-3e976d57-d379-4243-8387-f660b534a517 service neutron] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.157016 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Port e6483e56-c377-4575-bd34-b26a5c2bf382 on network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:11:50.157452 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Attempting to bind port e6483e56-c377-4575-bd34-b26a5c2bf382 on network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:50.171442 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.179666 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:50.180080 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Checking segment: {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:50.180608 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Bound using segment: {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'} {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:50.181394 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Bound port: e6483e56-c377-4575-bd34-b26a5c2bf382, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'}}] {{(pid=101664) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:50.181609 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.186807 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-363d261c-105a-475b-9fe2-045536baf6ed service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2642400 Nov 08 04:11:50.254017 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, cleared binding levels {{(pid=101664) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:50.257977 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101664) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:50.280829 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Pushing event updated for resources: {'Port': ['ID=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:50.285973 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-24e68716-dfaa-446e-8822-7d9d06b334e1 req-1a8268a4-7f29-45bb-84e5-c5e6eeb8b914 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1307058 Nov 08 04:11:50.329014 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.356958 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Attempting to bind port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:11:50.357292 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Attempting to bind port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:11:50.357677 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Attempting to bind port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 on network bd0479b2-da8e-41bd-929c-b9ece4aaa29f {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:50.388319 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 on network bd0479b2-da8e-41bd-929c-b9ece4aaa29f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:11:50.388888 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Attempting to bind port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 on network bd0479b2-da8e-41bd-929c-b9ece4aaa29f {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:11:50.400370 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:50.401238 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.403202 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] 10.222.0.16 "PUT /v2.0/ports/e6483e56-c377-4575-bd34-b26a5c2bf382 HTTP/1.1" status: 200 len: 1093 time: 2.0684445 Nov 08 04:11:50.405044 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:11:50.406172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Checking segment: {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:11:50.406172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Bound using segment: {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:11:50.406553 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:11:50.406649 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Bound port: d997f4bb-f698-4538-b9ae-f08bec1d6ff6, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:11:50.406649 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.408589 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e" -d '{"events": [{"name": "network-changed", "server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:11:50.455889 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57e5f3cb-729a-49e7-a9c6-c8510a60f9dc service neutron] Pushing event updated for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=3']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:50.484127 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cfef678b-369f-42c9-bd5a-6ed7c6046ca0 req-3e976d57-d379-4243-8387-f660b534a517 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.495054 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16b35e04-45a8-46e6-8505-5ee44a4a4c88 req-f103206d-b5d9-487d-a31a-a20c6cb81cb1 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:50.496667 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-16b35e04-45a8-46e6-8505-5ee44a4a4c88 req-f103206d-b5d9-487d-a31a-a20c6cb81cb1 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 943 time: 0.1763706 Nov 08 04:11:50.517481 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49876) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:50.537721 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a01e24af-9b5b-47fa-9e1f-8c84c0db2fb0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.598657 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] For port d997f4bb-f698-4538-b9ae-f08bec1d6ff6, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:11:50.600927 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cfef678b-369f-42c9-bd5a-6ed7c6046ca0 req-3e976d57-d379-4243-8387-f660b534a517 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.608839 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-10902576-eeb7-488f-b03e-1b433731c41f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:50.610632 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-10902576-eeb7-488f-b03e-1b433731c41f service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 1096 time: 0.0701270 Nov 08 04:11:50.657972 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] For port d997f4bb-f698-4538-b9ae-f08bec1d6ff6, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:11:50.666205 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca15eefe-04c1-4868-a6aa-e1e44d30f3d3 req-52f7574a-688e-49e5-971c-bef94ea4e901 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:50.667660 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ca15eefe-04c1-4868-a6aa-e1e44d30f3d3 req-52f7574a-688e-49e5-971c-bef94ea4e901 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 946 time: 0.1858265 Nov 08 04:11:50.683197 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-16b35e04-45a8-46e6-8505-5ee44a4a4c88 req-d2716082-d291-4078-b605-a90cd5b0c5d0 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1718380 Nov 08 04:11:50.683872 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-ba2bd3c8-c806-4429-9217-7b2a6e0bdaa0 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e6483e56-c377-4575-bd34-b26a5c2bf382 HTTP/1.1" status: 200 len: 217 time: 0.0454812 Nov 08 04:11:50.703909 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cfef678b-369f-42c9-bd5a-6ed7c6046ca0 req-3e976d57-d379-4243-8387-f660b534a517 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5612209 Nov 08 04:11:50.713255 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e976d57-d379-4243-8387-f660b534a517 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=69236acb-7000-4d03-8c21-963e670d4c64,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:50.743972 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.746686 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:11:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7c8b62b8-8e99-4a4f-800c-e802a7242a95 x-openstack-request-id: req-7c8b62b8-8e99-4a4f-800c-e802a7242a95 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:11:50.746976 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:11:50.747235 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-7c8b62b8-8e99-4a4f-800c-e802a7242a95 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:11:50.747560 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 4bc6cc8c-782d-4718-85b4-81156f4a2000 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:11:50.747670 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'status': 'completed', 'code': 200} Nov 08 04:11:50.759821 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a01e24af-9b5b-47fa-9e1f-8c84c0db2fb0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.778434 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-f3c67ad3-5853-4b06-a5dd-aa86af819d18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:50.778434 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-f3c67ad3-5853-4b06-a5dd-aa86af819d18 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.0825536 Nov 08 04:11:50.778719 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ca15eefe-04c1-4868-a6aa-e1e44d30f3d3 req-b9327c94-4c6e-4803-b370-74f2c1d27163 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0924385 Nov 08 04:11:50.786281 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:50.786932 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.788356 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] 10.222.0.16 "PUT /v2.0/ports/d997f4bb-f698-4538-b9ae-f08bec1d6ff6 HTTP/1.1" status: 200 len: 1093 time: 1.5622668 Nov 08 04:11:50.788741 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '12c1d323-bd37-4a14-be65-7a504c81950a', 'tag': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:11:50.791129 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f8c6da0-44e8-4f71-8b1d-0d43f6e57b9a" -d '{"events": [{"name": "network-changed", "server_uuid": "12c1d323-bd37-4a14-be65-7a504c81950a", "tag": "d997f4bb-f698-4538-b9ae-f08bec1d6ff6"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:11:50.826087 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78dc27e5-24bb-4ed5-acda-181acc618b10 service neutron] Pushing event updated for resources: {'Port': ['ID=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:50.828417 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a01e24af-9b5b-47fa-9e1f-8c84c0db2fb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.842123 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:11:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3e0a7e7-fcab-460a-800c-2d1ca17fbf10 x-openstack-request-id: req-b3e0a7e7-fcab-460a-800c-2d1ca17fbf10 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:11:50.842406 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "12c1d323-bd37-4a14-be65-7a504c81950a", "tag": "d997f4bb-f698-4538-b9ae-f08bec1d6ff6", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:11:50.846809 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-b3e0a7e7-fcab-460a-800c-2d1ca17fbf10 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:11:50.847955 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '12c1d323-bd37-4a14-be65-7a504c81950a', 'tag': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6', 'status': 'completed', 'code': 200} Nov 08 04:11:50.878330 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a01e24af-9b5b-47fa-9e1f-8c84c0db2fb0 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=26bc8e35084a463798628441d624f309&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3597498 Nov 08 04:11:50.878950 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 4bc6cc8c-782d-4718-85b4-81156f4a2000, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:50.879176 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a01e24af-9b5b-47fa-9e1f-8c84c0db2fb0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d496e4f-18f9-4c2e-ada5-4c4f1468fa8d,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:50.882266 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 49884) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:50.905910 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '4bc6cc8c-782d-4718-85b4-81156f4a2000', 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8', 'port_id': '4bc6cc8c-782d-4718-85b4-81156f4a2000', 'mac_address': 'fa:16:3e:fd:4f:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 170, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '900a12a5-1baa-47e1-8b64-245dc70bc9f2', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:11:50.957105 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.973542 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8bc330c5-37ad-4d79-b8d1-696a85ce4841 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:50.973783 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4bc6cc8c-782d-4718-85b4-81156f4a2000 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:51.009778 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 4bc6cc8c-782d-4718-85b4-81156f4a2000, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:51.012647 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8bc330c5-37ad-4d79-b8d1-696a85ce4841 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:51.108026 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ba4a9b-b03a-41e0-bd25-88097c8b041c req-f3969432-7c14-467c-b16e-53e0632ecdd6 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.109240 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-6016d7b9-7fe6-4f4c-af1a-96ec449d6a8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.109515 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-72ba4a9b-b03a-41e0-bd25-88097c8b041c req-f3969432-7c14-467c-b16e-53e0632ecdd6 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.1258323 Nov 08 04:11:51.110936 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-6016d7b9-7fe6-4f4c-af1a-96ec449d6a8c service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0559709 Nov 08 04:11:51.127729 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc819c5a-cade-4c98-bbcf-148d05b7d84f req-9150fdbf-2d3d-4509-9946-a76da3ab7149 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.129161 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc819c5a-cade-4c98-bbcf-148d05b7d84f req-9150fdbf-2d3d-4509-9946-a76da3ab7149 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 943 time: 0.1015828 Nov 08 04:11:51.137084 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:51.176981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f8c6da0-44e8-4f71-8b1d-0d43f6e57b9a req-d63660e1-0cd3-495e-b5d0-f28da0325401 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.178424 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f8c6da0-44e8-4f71-8b1d-0d43f6e57b9a req-d63660e1-0cd3-495e-b5d0-f28da0325401 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 1096 time: 0.1076615 Nov 08 04:11:51.185604 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8bc330c5-37ad-4d79-b8d1-696a85ce4841 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:51.188215 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8bc330c5-37ad-4d79-b8d1-696a85ce4841 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:51.189347 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-8bc330c5-37ad-4d79-b8d1-696a85ce4841 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/1d496e4f-18f9-4c2e-ada5-4c4f1468fa8d HTTP/1.1" status: 204 len: 168 time: 0.3058167 Nov 08 04:11:51.201107 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=4bc6cc8c-782d-4718-85b4-81156f4a2000,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:51.204207 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bc330c5-37ad-4d79-b8d1-696a85ce4841 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d496e4f-18f9-4c2e-ada5-4c4f1468fa8d,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:51.226812 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-72ba4a9b-b03a-41e0-bd25-88097c8b041c req-58216027-01d4-443b-bdc2-573b5f7fc5f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1098113 Nov 08 04:11:51.268651 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-d899e732-1070-4c26-8eea-01f0491ee928 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1461265 Nov 08 04:11:51.271440 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc819c5a-cade-4c98-bbcf-148d05b7d84f req-a123877c-94a8-4b5f-9992-053df2a3f897 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1351929 Nov 08 04:11:51.319512 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f8c6da0-44e8-4f71-8b1d-0d43f6e57b9a req-2afd38ab-6224-43d8-88ba-5ec91932ab3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.321674 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f8c6da0-44e8-4f71-8b1d-0d43f6e57b9a req-2afd38ab-6224-43d8-88ba-5ec91932ab3e service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1237149 Nov 08 04:11:51.385100 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-8bf9f91e-ab6f-43bb-aac9-c1ee697356db req-8d39b907-75e2-466e-b57f-cbe59d34ba8e service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1058643 Nov 08 04:11:51.451622 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['4bc6cc8c-782d-4718-85b4-81156f4a2000'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:11:51.486133 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce955c89-7d55-4d35-a36e-c7afe5c481e5 req-4120994b-b0b1-4d8b-8b4c-b06f43342104 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.491468 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce955c89-7d55-4d35-a36e-c7afe5c481e5 req-4120994b-b0b1-4d8b-8b4c-b06f43342104 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 945 time: 0.1128738 Nov 08 04:11:51.505542 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f8c6da0-44e8-4f71-8b1d-0d43f6e57b9a req-10c822b8-1d43-4c70-8856-2f3477fef220 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.507052 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f8c6da0-44e8-4f71-8b1d-0d43f6e57b9a req-10c822b8-1d43-4c70-8856-2f3477fef220 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1771593 Nov 08 04:11:51.550331 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce955c89-7d55-4d35-a36e-c7afe5c481e5 req-16899f1b-cafc-49d5-8039-bc584037f7ba tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549197 Nov 08 04:11:51.651055 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-16a4c5fa-761f-4a6d-8909-94fd3da2aadc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.652530 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-16a4c5fa-761f-4a6d-8909-94fd3da2aadc service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 1096 time: 0.0460751 Nov 08 04:11:51.667625 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea11211-2367-467d-bbbc-14584cb77159 req-ba894133-da62-4fb7-b2d7-cdb7942afb6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.669481 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-ba894133-da62-4fb7-b2d7-cdb7942afb6b service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 1096 time: 0.0475712 Nov 08 04:11:51.703340 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f882d66b-3620-4d68-9751-4f2683e2d565', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8b44127-b903-47ea-98e3-772137eab0f6'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:11:51.716750 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-57d1d5be-f40f-49f3-aaff-67c55755dfe4" -d '{"events": [{"server_uuid": "f882d66b-3620-4d68-9751-4f2683e2d565", "name": "network-vif-plugged", "status": "completed", "tag": "c8b44127-b903-47ea-98e3-772137eab0f6"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:11:51.721464 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-e461fe73-0a54-4a79-90dd-121a9075b734 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d997f4bb-f698-4538-b9ae-f08bec1d6ff6 HTTP/1.1" status: 200 len: 217 time: 0.0365741 Nov 08 04:11:51.761588 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-62da5325-3cbb-4a0b-92b6-0626912d66e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.763878 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-62da5325-3cbb-4a0b-92b6-0626912d66e7 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 918 time: 0.1013556 Nov 08 04:11:51.773672 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:11:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6313843-a24f-4eb5-a83e-18d7971150e9 x-openstack-request-id: req-e6313843-a24f-4eb5-a83e-18d7971150e9 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:11:51.773822 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f882d66b-3620-4d68-9751-4f2683e2d565", "name": "network-vif-plugged", "status": "completed", "tag": "c8b44127-b903-47ea-98e3-772137eab0f6", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:11:51.773969 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-e6313843-a24f-4eb5-a83e-18d7971150e9 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:11:51.774938 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f882d66b-3620-4d68-9751-4f2683e2d565', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8b44127-b903-47ea-98e3-772137eab0f6', 'code': 200} Nov 08 04:11:51.795347 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea11211-2367-467d-bbbc-14584cb77159 req-f18efc06-7008-45d1-b576-cb5faad2316c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.796869 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-f18efc06-7008-45d1-b576-cb5faad2316c service neutron] 10.222.0.16 "GET /v2.0/subnets?id=1158e941-c129-49d0-9b8b-ba72d0ef6717 HTTP/1.1" status: 200 len: 850 time: 0.0675869 Nov 08 04:11:51.859587 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-148fd9d8-2ae0-41d7-a597-819ca47b76de service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e6483e56-c377-4575-bd34-b26a5c2bf382 HTTP/1.1" status: 200 len: 217 time: 0.0474110 Nov 08 04:11:51.868543 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-668038a5-8b14-4f5c-8f8a-7d275b641607 req-c2363447-2821-4148-b08a-2e3525e29f50 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.870013 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-668038a5-8b14-4f5c-8f8a-7d275b641607 req-c2363447-2821-4148-b08a-2e3525e29f50 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 943 time: 0.0939753 Nov 08 04:11:51.877116 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea11211-2367-467d-bbbc-14584cb77159 req-e0a34a24-3de8-47b5-a102-9d00533c818d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:51.878681 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-e0a34a24-3de8-47b5-a102-9d00533c818d service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0679386 Nov 08 04:11:51.982646 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-400787c8-1557-4394-9ff7-0661289491b9 service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922921 Nov 08 04:11:52.091279 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9ea11211-2367-467d-bbbc-14584cb77159 req-6750ae7b-3ac0-4e85-a7a3-becfaf5ff11d service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0989296 Nov 08 04:11:52.158224 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-1984915d-3e25-4ad3-adc3-2901f944bd61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:52.159918 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-1984915d-3e25-4ad3-adc3-2901f944bd61 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.2889674 Nov 08 04:11:52.171991 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-668038a5-8b14-4f5c-8f8a-7d275b641607 req-4d6f542f-dbea-4d23-9ac0-207a5d0e539b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2937236 Nov 08 04:11:52.198524 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9103e25-658f-4926-a240-2e8cb93ad4fb req-54749788-ae18-4652-9541-fb8d4d1ba301 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:52.199995 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9103e25-658f-4926-a240-2e8cb93ad4fb req-54749788-ae18-4652-9541-fb8d4d1ba301 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 946 time: 0.1079657 Nov 08 04:11:52.224503 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45449946-69dc-4966-833c-8609ad7349c9 req-d714040c-0ee9-4714-b981-c1bdc650ee5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:52.226179 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-45449946-69dc-4966-833c-8609ad7349c9 req-d714040c-0ee9-4714-b981-c1bdc650ee5f service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 1098 time: 0.0902557 Nov 08 04:11:52.265034 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-5dcfc2b6-edab-4661-a42c-a0cf6eb332a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:52.266546 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-5dcfc2b6-edab-4661-a42c-a0cf6eb332a5 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0934303 Nov 08 04:11:52.281350 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9103e25-658f-4926-a240-2e8cb93ad4fb req-9eb32243-da68-4d9c-9cef-5ca44d72fd50 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647616 Nov 08 04:11:52.366296 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-45449946-69dc-4966-833c-8609ad7349c9 req-7ce1d344-729a-4c97-b32a-24bc162183ad service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525081 Nov 08 04:11:52.460812 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a23447d-bb86-4492-b482-bfc3d612fc7a req-e4ac2879-bec1-4d63-883f-0590521019de tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:52.462308 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7a23447d-bb86-4492-b482-bfc3d612fc7a req-e4ac2879-bec1-4d63-883f-0590521019de tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.1516199 Nov 08 04:11:52.493933 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-0edbc4ed-0e3c-4f1b-bf29-565dfca8f8d1 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1731598 Nov 08 04:11:52.503165 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad7f6dae-4b13-4c79-8f87-4d12c16071c4 req-dde6c0d4-eaa2-49ea-b47e-389d1ea24b0a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:52.504563 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ad7f6dae-4b13-4c79-8f87-4d12c16071c4 req-dde6c0d4-eaa2-49ea-b47e-389d1ea24b0a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 943 time: 0.1405299 Nov 08 04:11:52.545618 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7a23447d-bb86-4492-b482-bfc3d612fc7a req-5ff5db67-ff77-432d-a2c8-108e7addd867 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0727582 Nov 08 04:11:52.572215 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ad7f6dae-4b13-4c79-8f87-4d12c16071c4 req-5b7ba18f-2700-4aaa-8244-9bd505ae6383 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563567 Nov 08 04:11:52.729478 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f04d64a-836a-4190-9a49-17bf34f81a96 req-616b0c35-70cb-4ab1-8e54-2f61532413ff tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:52.730988 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f04d64a-836a-4190-9a49-17bf34f81a96 req-616b0c35-70cb-4ab1-8e54-2f61532413ff tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 945 time: 0.1064470 Nov 08 04:11:52.760020 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 4bc6cc8c-782d-4718-85b4-81156f4a2000 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:11:52.771557 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc2c818a-2b08-4494-afe0-8d5a7f4b473e req-65f5a45f-fcf4-4686-b4e7-64b64a360468 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1186850 Nov 08 04:11:52.794765 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f04d64a-836a-4190-9a49-17bf34f81a96 req-75073a90-6a05-4c05-992b-ec471c40c2aa tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558558 Nov 08 04:11:52.877488 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 4bc6cc8c-782d-4718-85b4-81156f4a2000 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:11:52.881756 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 4bc6cc8c-782d-4718-85b4-81156f4a2000 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:11:52.882167 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:52.961325 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:52.994578 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 4bc6cc8c-782d-4718-85b4-81156f4a2000, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:53.082472 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:53.131438 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=4bc6cc8c-782d-4718-85b4-81156f4a2000,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:53.304890 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-293ad8de-48f7-4172-93ad-5e2d06861386 req-9387dd34-d12f-45c3-b19c-37f26fd9e3cb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:53.304890 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-293ad8de-48f7-4172-93ad-5e2d06861386 req-9387dd34-d12f-45c3-b19c-37f26fd9e3cb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 943 time: 0.0518265 Nov 08 04:11:53.355885 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-293ad8de-48f7-4172-93ad-5e2d06861386 req-d05a1e04-4bf0-402d-a0cb-2743c7ed2aaa tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443492 Nov 08 04:11:53.415409 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a83a177-fc12-4c39-bbd7-b9123cbc5c81 req-f0c094c0-0584-4536-a68f-a2b0af9ec769 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:53.416889 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8a83a177-fc12-4c39-bbd7-b9123cbc5c81 req-f0c094c0-0584-4536-a68f-a2b0af9ec769 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 946 time: 0.0568218 Nov 08 04:11:53.465536 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8a83a177-fc12-4c39-bbd7-b9123cbc5c81 req-e7bdd27a-1c1d-41fe-89ec-9bbc2499c5e6 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424910 Nov 08 04:11:53.717708 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1a2cd6-efe8-44a8-a978-7ec0f98000d2 req-a2318b9e-c06f-4398-8bfe-b407fe1b78fb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:53.719269 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bc1a2cd6-efe8-44a8-a978-7ec0f98000d2 req-a2318b9e-c06f-4398-8bfe-b407fe1b78fb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0890632 Nov 08 04:11:53.727644 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e0f5eb-4051-4d91-8b1d-0fe3e0988b5f req-473595c0-9481-4d65-8ce6-e0649f4eab7e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:53.729018 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9e0f5eb-4051-4d91-8b1d-0fe3e0988b5f req-473595c0-9481-4d65-8ce6-e0649f4eab7e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 943 time: 0.0671060 Nov 08 04:11:53.775855 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6ac78e1d-3043-41a2-9a5d-08f026444d81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4bc6cc8c-782d-4718-85b4-81156f4a2000'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:11:53.783982 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c0acf017-2d87-4e75-9b37-f316ad3ecba2" -d '{"events": [{"server_uuid": "6ac78e1d-3043-41a2-9a5d-08f026444d81", "name": "network-vif-plugged", "status": "completed", "tag": "4bc6cc8c-782d-4718-85b4-81156f4a2000"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:11:53.800993 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bc1a2cd6-efe8-44a8-a978-7ec0f98000d2 req-7cd2fb9e-c1df-4063-8ae4-645b9d2d2db4 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0710027 Nov 08 04:11:53.804239 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9e0f5eb-4051-4d91-8b1d-0fe3e0988b5f req-23874012-785e-4e05-8de7-fa091c04d5e0 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685129 Nov 08 04:11:53.853431 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:11:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-911cf32d-aa52-45f3-aef7-525802fb9bd2 x-openstack-request-id: req-911cf32d-aa52-45f3-aef7-525802fb9bd2 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:11:53.853747 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6ac78e1d-3043-41a2-9a5d-08f026444d81", "name": "network-vif-plugged", "status": "completed", "tag": "4bc6cc8c-782d-4718-85b4-81156f4a2000", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:11:53.854002 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-911cf32d-aa52-45f3-aef7-525802fb9bd2 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:11:53.854436 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6ac78e1d-3043-41a2-9a5d-08f026444d81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4bc6cc8c-782d-4718-85b4-81156f4a2000', 'code': 200} Nov 08 04:11:53.923987 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c524078-783a-4c0a-8ea0-8b96f68a71d6 req-ac4adc3c-1d18-4a57-a07f-12d3ae358f5d tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:53.925533 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c524078-783a-4c0a-8ea0-8b96f68a71d6 req-ac4adc3c-1d18-4a57-a07f-12d3ae358f5d tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 945 time: 0.0482824 Nov 08 04:11:53.972247 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c524078-783a-4c0a-8ea0-8b96f68a71d6 req-3d9d5a20-8a58-4509-a855-bf79e29dc815 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398748 Nov 08 04:11:54.151118 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:54.236627 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6223f4c6-c538-40c2-ae6d-0202774ebfa7 req-57b39c07-679c-49d0-9e5d-622e42005042 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:54.238348 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6223f4c6-c538-40c2-ae6d-0202774ebfa7 req-57b39c07-679c-49d0-9e5d-622e42005042 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 1098 time: 0.0450590 Nov 08 04:11:54.284745 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6223f4c6-c538-40c2-ae6d-0202774ebfa7 req-79e20662-d1eb-4c21-8e0a-1c1a110eb609 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382452 Nov 08 04:11:54.475386 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a3585f-3524-4e07-b7e6-6cbfbd475a34 req-0d790954-0959-45be-a64b-bc5dc9e6b996 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:54.477090 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-13a3585f-3524-4e07-b7e6-6cbfbd475a34 req-0d790954-0959-45be-a64b-bc5dc9e6b996 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 943 time: 0.0517132 Nov 08 04:11:54.526909 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-13a3585f-3524-4e07-b7e6-6cbfbd475a34 req-eba4b253-4047-4020-b681-bb88f767f4ad tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430272 Nov 08 04:11:54.766126 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:11:54.868062 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:54.881054 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '4e88411d-7ee7-4112-84b9-3f6a87ffd8e6', 'network_id': '8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8', 'port_id': '4e88411d-7ee7-4112-84b9-3f6a87ffd8e6', 'mac_address': 'fa:16:3e:05:69:3d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 170, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '900a12a5-1baa-47e1-8b64-245dc70bc9f2', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:11:54.926641 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:54.940281 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:54.955282 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e14180ea-e25f-4db0-87a8-86562b7a11de req-aaf42931-4b3e-4493-843b-ae9edab9e7de tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:54.956753 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e14180ea-e25f-4db0-87a8-86562b7a11de req-aaf42931-4b3e-4493-843b-ae9edab9e7de tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 943 time: 0.0804806 Nov 08 04:11:54.959834 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:54.964786 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf46160-c852-45c4-af1b-720e4989cebf req-a4557ae5-a4e0-4020-8d67-c42c67e99a0b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:54.966144 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7bf46160-c852-45c4-af1b-720e4989cebf req-a4557ae5-a4e0-4020-8d67-c42c67e99a0b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0793953 Nov 08 04:11:55.038385 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e14180ea-e25f-4db0-87a8-86562b7a11de req-c91525ef-cc85-4e31-84ce-aeed055a08ee tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712416 Nov 08 04:11:55.042748 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7bf46160-c852-45c4-af1b-720e4989cebf req-8d135ab3-14eb-4cd9-bc38-86c6c26d3204 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0690668 Nov 08 04:11:55.051699 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:55.052276 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device e6483e56-c377-4575-bd34-b26a5c2bf382 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:11:55.189664 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:55.334200 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:55.346069 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'port_id': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'mac_address': 'fa:16:3e:b2:b0:ef', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 184, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:11:55.388962 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:55.402712 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e6483e56-c377-4575-bd34-b26a5c2bf382 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:55.423846 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:55.489412 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:55.540995 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:55.641171 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec4b9d0e-399d-4597-81d1-f36f07952ebd req-ed5d4b29-8b21-4c41-9828-828d8475f5b1 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:55.642680 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ec4b9d0e-399d-4597-81d1-f36f07952ebd req-ed5d4b29-8b21-4c41-9828-828d8475f5b1 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 943 time: 0.0493388 Nov 08 04:11:55.695636 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ec4b9d0e-399d-4597-81d1-f36f07952ebd req-cd10518a-4328-4ef0-a677-bc1f5c83183c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469320 Nov 08 04:11:55.810516 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50032) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:55.919822 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-636b785e-ab16-4b65-8c31-3092c963213c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:55.923999 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['4e88411d-7ee7-4112-84b9-3f6a87ffd8e6'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:11:55.956791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['e6483e56-c377-4575-bd34-b26a5c2bf382'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:11:55.993919 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-636b785e-ab16-4b65-8c31-3092c963213c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:56.093747 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-636b785e-ab16-4b65-8c31-3092c963213c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:56.135872 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-636b785e-ab16-4b65-8c31-3092c963213c admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=3a7c71df8fa84f5d876829a541998c1f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3218138 Nov 08 04:11:56.135872 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-636b785e-ab16-4b65-8c31-3092c963213c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97bfcde2-91d9-4173-a106-f87971421204,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:56.136306 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50040) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:56.229308 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eebe5485-66ef-44c9-a49c-e7cf9e88c23f req-b8d1688e-c09e-4ff5-8c9d-d8f393d52fec tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:56.229463 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eebe5485-66ef-44c9-a49c-e7cf9e88c23f req-b8d1688e-c09e-4ff5-8c9d-d8f393d52fec tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 944 time: 0.0870421 Nov 08 04:11:56.264526 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c7316632-24b8-4cd7-ac8d-3435bca685c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:56.304300 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c7316632-24b8-4cd7-ac8d-3435bca685c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:56.309029 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eebe5485-66ef-44c9-a49c-e7cf9e88c23f req-43b549e0-b1fe-4c94-9f6c-7f7db2abac73 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0720744 Nov 08 04:11:56.382781 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe9a01b2-cf0a-4d52-979d-824be50430c9 req-a0667b88-8802-4b62-8292-277f110aa7e5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:56.384949 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fe9a01b2-cf0a-4d52-979d-824be50430c9 req-a0667b88-8802-4b62-8292-277f110aa7e5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 944 time: 0.0703173 Nov 08 04:11:56.442237 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fe9a01b2-cf0a-4d52-979d-824be50430c9 req-e93537c9-e952-419d-853a-34a1e0d6347d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510163 Nov 08 04:11:56.475655 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c7316632-24b8-4cd7-ac8d-3435bca685c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:56.478436 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c7316632-24b8-4cd7-ac8d-3435bca685c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:56.479563 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-c7316632-24b8-4cd7-ac8d-3435bca685c1 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/97bfcde2-91d9-4173-a106-f87971421204 HTTP/1.1" status: 204 len: 168 time: 0.3423281 Nov 08 04:11:56.492851 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7316632-24b8-4cd7-ac8d-3435bca685c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97bfcde2-91d9-4173-a106-f87971421204,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:56.769098 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d997f4bb-f698-4538-b9ae-f08bec1d6ff6 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:11:56.830678 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb8d08f-9c9d-4888-a194-9340b12a4323 req-dab67622-5f1b-46bf-8761-92a5457239c7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:56.833562 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0bb8d08f-9c9d-4888-a194-9340b12a4323 req-dab67622-5f1b-46bf-8761-92a5457239c7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 943 time: 0.0544708 Nov 08 04:11:56.884471 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d997f4bb-f698-4538-b9ae-f08bec1d6ff6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:56.891626 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0bb8d08f-9c9d-4888-a194-9340b12a4323 req-e9c4f068-f7bb-4fe5-a1f9-9c5ec3565490 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470309 Nov 08 04:11:56.900226 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'port_id': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6', 'mac_address': 'fa:16:3e:9c:ca:fe', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 161, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:11:56.954437 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:56.971249 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d997f4bb-f698-4538-b9ae-f08bec1d6ff6 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:11:56.996720 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d997f4bb-f698-4538-b9ae-f08bec1d6ff6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:11:57.062139 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:57.108157 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:57.247966 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50082) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:57.260488 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1a3c2736-e0cd-49f8-aa1c-d76fe137d568 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:57.332513 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1a3c2736-e0cd-49f8-aa1c-d76fe137d568 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:57.408717 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1a3c2736-e0cd-49f8-aa1c-d76fe137d568 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:57.457113 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-1a3c2736-e0cd-49f8-aa1c-d76fe137d568 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=4621884690cf40cd94068e71af5309ce&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2079937 Nov 08 04:11:57.459827 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50090) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:57.460318 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a3c2736-e0cd-49f8-aa1c-d76fe137d568 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af9ee8b6-5d79-4c79-8630-3ff49f400d8c,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:57.473201 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7300be8d-203c-469d-92c2-7127a9fe8581 req-149c1434-6b5f-4c72-aa87-4259a0068480 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:57.476350 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7300be8d-203c-469d-92c2-7127a9fe8581 req-149c1434-6b5f-4c72-aa87-4259a0068480 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 944 time: 0.0946920 Nov 08 04:11:57.517036 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f7f8b18c-a562-4da9-bb97-a813334ff2d7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:57.530900 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7300be8d-203c-469d-92c2-7127a9fe8581 req-dd3ba06a-55cf-406b-a267-11d310794f47 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490148 Nov 08 04:11:57.540653 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f7f8b18c-a562-4da9-bb97-a813334ff2d7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:57.586890 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-714daf18-9b64-48f4-bfa9-9fe9c8873d87 req-2a7134fa-b22b-4cae-be41-477e9e3b800b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:57.586890 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-714daf18-9b64-48f4-bfa9-9fe9c8873d87 req-2a7134fa-b22b-4cae-be41-477e9e3b800b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 944 time: 0.0535929 Nov 08 04:11:57.633561 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-714daf18-9b64-48f4-bfa9-9fe9c8873d87 req-03d85416-e5af-40e6-bde2-3b6d8ba741ae tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413895 Nov 08 04:11:57.645476 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f7f8b18c-a562-4da9-bb97-a813334ff2d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:57.648329 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f7f8b18c-a562-4da9-bb97-a813334ff2d7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:57.649980 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f7f8b18c-a562-4da9-bb97-a813334ff2d7 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/af9ee8b6-5d79-4c79-8630-3ff49f400d8c HTTP/1.1" status: 204 len: 168 time: 0.1891744 Nov 08 04:11:57.657904 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f8b18c-a562-4da9-bb97-a813334ff2d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af9ee8b6-5d79-4c79-8630-3ff49f400d8c,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:58.011731 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1c2f6e7-9463-4209-801e-7f71cfe6c3e5 req-9e828372-4207-421a-8dd5-4dc6e61607db tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:58.013280 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a1c2f6e7-9463-4209-801e-7f71cfe6c3e5 req-9e828372-4207-421a-8dd5-4dc6e61607db tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 944 time: 0.0519335 Nov 08 04:11:58.061556 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a1c2f6e7-9463-4209-801e-7f71cfe6c3e5 req-c6f15010-7275-4040-ade5-42fa4f40013a tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419347 Nov 08 04:11:58.368297 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50112) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:58.381316 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4f533a68-856a-4ad3-82b7-4346a1b6ffbb admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.383123 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50114) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:58.467906 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4f533a68-856a-4ad3-82b7-4346a1b6ffbb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.538078 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dffdae28-1e7e-4ccb-a71e-4868874a7112 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.557734 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4f533a68-856a-4ad3-82b7-4346a1b6ffbb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.609466 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-4f533a68-856a-4ad3-82b7-4346a1b6ffbb admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=df762868544e4dfe91fb6ca9918ef443&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2400379 Nov 08 04:11:58.611357 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f533a68-856a-4ad3-82b7-4346a1b6ffbb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0617cec0-315e-4a86-98d9-ffa7ab09b329,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:58.613835 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50120) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:58.661588 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b262e1ef-c308-4166-9e65-b2b8697a9859 req-0e3f0b3e-3bcf-4b34-8663-62c2324c8370 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:58.663667 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b262e1ef-c308-4166-9e65-b2b8697a9859 req-0e3f0b3e-3bcf-4b34-8663-62c2324c8370 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 944 time: 0.0502560 Nov 08 04:11:58.686671 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dffdae28-1e7e-4ccb-a71e-4868874a7112 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.691981 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3178f3af-f344-44de-912d-67250f2ffe38 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.713860 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b262e1ef-c308-4166-9e65-b2b8697a9859 req-748b9bdf-56c1-448a-81d2-b3eb046d5948 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433366 Nov 08 04:11:58.714102 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3178f3af-f344-44de-912d-67250f2ffe38 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.765694 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d53e0e58-e15f-4c73-87e6-c5fc51233250 req-99d407eb-7861-4653-af6b-49c6aa0e3a96 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:58.767255 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d53e0e58-e15f-4c73-87e6-c5fc51233250 req-99d407eb-7861-4653-af6b-49c6aa0e3a96 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 944 time: 0.0574181 Nov 08 04:11:58.771673 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dffdae28-1e7e-4ccb-a71e-4868874a7112 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.808825 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dffdae28-1e7e-4ccb-a71e-4868874a7112 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6195e65d-ce76-4520-99a3-33fff1e6463c,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:58.814263 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-dffdae28-1e7e-4ccb-a71e-4868874a7112 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=2e5bb297dae04244b84fad50df33456b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4277198 Nov 08 04:11:58.817179 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50130) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:58.837260 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d53e0e58-e15f-4c73-87e6-c5fc51233250 req-9e4b7d7a-e1f1-4109-9422-606b8b6c4ced tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631731 Nov 08 04:11:58.853938 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3178f3af-f344-44de-912d-67250f2ffe38 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.856721 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3178f3af-f344-44de-912d-67250f2ffe38 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.857853 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-3178f3af-f344-44de-912d-67250f2ffe38 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/0617cec0-315e-4a86-98d9-ffa7ab09b329 HTTP/1.1" status: 204 len: 168 time: 0.2400556 Nov 08 04:11:58.870058 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3178f3af-f344-44de-912d-67250f2ffe38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0617cec0-315e-4a86-98d9-ffa7ab09b329,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:58.876061 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ca08f38a-2ba6-4cb0-8617-f7d8bc556d93 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.908154 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ca08f38a-2ba6-4cb0-8617-f7d8bc556d93 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:58.968924 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:11:59.013676 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ca08f38a-2ba6-4cb0-8617-f7d8bc556d93 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:59.016162 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ca08f38a-2ba6-4cb0-8617-f7d8bc556d93 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:59.019733 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ca08f38a-2ba6-4cb0-8617-f7d8bc556d93 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/6195e65d-ce76-4520-99a3-33fff1e6463c HTTP/1.1" status: 204 len: 168 time: 0.1991918 Nov 08 04:11:59.025770 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca08f38a-2ba6-4cb0-8617-f7d8bc556d93 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6195e65d-ce76-4520-99a3-33fff1e6463c,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:59.177896 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ce67622-e079-47d0-bdb6-d30490c32478 req-f5912645-c60a-4436-a185-100d2165433d tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:59.179391 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6ce67622-e079-47d0-bdb6-d30490c32478 req-f5912645-c60a-4436-a185-100d2165433d tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 944 time: 0.0495198 Nov 08 04:11:59.228131 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6ce67622-e079-47d0-bdb6-d30490c32478 req-c516a0a3-c372-4b54-a9c6-1d15d251299b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422587 Nov 08 04:11:59.665231 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50156) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:11:59.681712 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c7c7a8fe-8ada-4d1c-a7cb-58f997f230ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:59.773366 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c7c7a8fe-8ada-4d1c-a7cb-58f997f230ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:59.840788 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8402e4c4-908f-4908-9ad2-8eb6bb5dc647 req-fe651bea-80f4-4c97-b84c-ecc22a6c6281 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:11:59.840788 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8402e4c4-908f-4908-9ad2-8eb6bb5dc647 req-fe651bea-80f4-4c97-b84c-ecc22a6c6281 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 944 time: 0.0478480 Nov 08 04:11:59.869889 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c7c7a8fe-8ada-4d1c-a7cb-58f997f230ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:11:59.991663 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-c7c7a8fe-8ada-4d1c-a7cb-58f997f230ec admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=f65cccdcdefe415aa1018892805c015a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2890759 Nov 08 04:11:59.991663 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c7a8fe-8ada-4d1c-a7cb-58f997f230ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f2334a9-89a9-4934-b44c-ebeadcdfdc8b,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:11:59.991663 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8402e4c4-908f-4908-9ad2-8eb6bb5dc647 req-3d99ada2-db8c-482a-a297-663ef0d7cfa9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1354172 Nov 08 04:11:59.992185 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50170) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:00.006428 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac38590e-7ad5-404e-851d-0882ebdb3a23 req-4f7ef38f-4e82-4a7d-b601-35b590d3b4f0 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:00.008855 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac38590e-7ad5-404e-851d-0882ebdb3a23 req-4f7ef38f-4e82-4a7d-b601-35b590d3b4f0 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 944 time: 0.0735295 Nov 08 04:12:00.035389 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:12:00.068538 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac38590e-7ad5-404e-851d-0882ebdb3a23 req-05a09de6-d5b5-4871-bfbe-9d52b4069180 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535030 Nov 08 04:12:00.083163 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2dac3c3d-1c44-4db6-98d9-0935cd66cc24 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:00.106907 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2dac3c3d-1c44-4db6-98d9-0935cd66cc24 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:00.165299 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:12:00.169955 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:12:00.170318 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:00.244832 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:00.248314 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2dac3c3d-1c44-4db6-98d9-0935cd66cc24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:00.253371 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2dac3c3d-1c44-4db6-98d9-0935cd66cc24 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:00.259522 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-2dac3c3d-1c44-4db6-98d9-0935cd66cc24 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/8f2334a9-89a9-4934-b44c-ebeadcdfdc8b HTTP/1.1" status: 204 len: 168 time: 0.2677984 Nov 08 04:12:00.267726 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dac3c3d-1c44-4db6-98d9-0935cd66cc24 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f2334a9-89a9-4934-b44c-ebeadcdfdc8b,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:00.268415 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '63ce1fee-21b7-44fe-8e44-78d58a2f9174', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4e88411d-7ee7-4112-84b9-3f6a87ffd8e6'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:12:00.270976 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee3f29d0-743c-46e7-8b16-ad9413368fe7" -d '{"events": [{"server_uuid": "63ce1fee-21b7-44fe-8e44-78d58a2f9174", "name": "network-vif-plugged", "status": "completed", "tag": "4e88411d-7ee7-4112-84b9-3f6a87ffd8e6"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:12:00.286779 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['d997f4bb-f698-4538-b9ae-f08bec1d6ff6'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:12:00.318449 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:12:00.320399 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:12:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bec6817-5435-40ff-a98c-30a007fbb726 x-openstack-request-id: req-0bec6817-5435-40ff-a98c-30a007fbb726 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:12:00.320738 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "63ce1fee-21b7-44fe-8e44-78d58a2f9174", "name": "network-vif-plugged", "status": "completed", "tag": "4e88411d-7ee7-4112-84b9-3f6a87ffd8e6", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:12:00.320983 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-0bec6817-5435-40ff-a98c-30a007fbb726 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:12:00.321573 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '63ce1fee-21b7-44fe-8e44-78d58a2f9174', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4e88411d-7ee7-4112-84b9-3f6a87ffd8e6', 'code': 200} Nov 08 04:12:00.392461 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:00.393127 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device e6483e56-c377-4575-bd34-b26a5c2bf382 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:12:00.405748 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a86278f-a30e-42ab-a03c-72164bd437a2 req-4d64c618-7233-4d2d-8cf4-962f28cb0d00 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:00.407631 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a86278f-a30e-42ab-a03c-72164bd437a2 req-4d64c618-7233-4d2d-8cf4-962f28cb0d00 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 944 time: 0.0617688 Nov 08 04:12:00.470244 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a86278f-a30e-42ab-a03c-72164bd437a2 req-b75bf98a-1793-4d1c-8b93-4749f56b9039 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521629 Nov 08 04:12:00.527035 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:00.633840 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port e6483e56-c377-4575-bd34-b26a5c2bf382 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:12:00.638408 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port e6483e56-c377-4575-bd34-b26a5c2bf382 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:12:00.638408 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:00.678697 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f993755b-7862-44e1-a395-8f033e8ac6ca req-bc505954-3a18-4a4a-a935-5075153682f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:00.680203 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f993755b-7862-44e1-a395-8f033e8ac6ca req-bc505954-3a18-4a4a-a935-5075153682f9 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 1098 time: 0.0401647 Nov 08 04:12:00.729058 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:00.764047 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f993755b-7862-44e1-a395-8f033e8ac6ca req-98ee7a0c-2b3f-431c-b384-4216a76b8572 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672154 Nov 08 04:12:00.775165 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:12:00.853565 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:00.917333 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:01.117079 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-085d2a58-9a66-419c-94e1-0c8664ee4ede req-36d54b47-7796-4a65-98d0-ce5a8287e031 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:01.119055 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-085d2a58-9a66-419c-94e1-0c8664ee4ede req-36d54b47-7796-4a65-98d0-ce5a8287e031 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0532348 Nov 08 04:12:01.198696 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-085d2a58-9a66-419c-94e1-0c8664ee4ede req-385eeeb4-17b4-49d0-a73b-13fe29c7f5d5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0713403 Nov 08 04:12:01.218105 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8076e6-13e6-4f05-b082-1610f66ffcc7 req-b81576f6-cdc7-4a9e-9b8c-277deb6f61a4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:01.219593 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7b8076e6-13e6-4f05-b082-1610f66ffcc7 req-b81576f6-cdc7-4a9e-9b8c-277deb6f61a4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0713346 Nov 08 04:12:01.267973 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7b8076e6-13e6-4f05-b082-1610f66ffcc7 req-e9381a58-cd4d-44d7-8753-b5ed66c7e9da tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421278 Nov 08 04:12:01.589444 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52675c91-f311-4632-9b19-55756a217ee6 req-7bbb8045-f207-4435-b635-246e284062db tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:01.591084 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-52675c91-f311-4632-9b19-55756a217ee6 req-7bbb8045-f207-4435-b635-246e284062db tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 944 time: 0.0517499 Nov 08 04:12:01.641875 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-52675c91-f311-4632-9b19-55756a217ee6 req-b295c591-3907-40ea-b5eb-b65cfed78562 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449204 Nov 08 04:12:02.321578 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-568dd0a7-3965-42f5-9c68-4cbad90feefa req-5e2eda6c-4c15-4955-ba92-fda9d5106fe1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:02.322679 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:12:02.323344 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-568dd0a7-3965-42f5-9c68-4cbad90feefa req-5e2eda6c-4c15-4955-ba92-fda9d5106fe1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0519841 Nov 08 04:12:02.324947 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ece4786-7479-4f40-b8ff-e607bd814976" -d '{"events": [{"server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "name": "network-vif-plugged", "status": "completed", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:12:02.405045 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-568dd0a7-3965-42f5-9c68-4cbad90feefa req-94c90558-8a10-494b-9a89-f413986b380f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0759118 Nov 08 04:12:02.432019 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85bcfb8a-ef9f-40bd-b8d1-7a0f74028565 req-7054269d-6ded-4f86-9a83-e524d4c26191 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:02.434325 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85bcfb8a-ef9f-40bd-b8d1-7a0f74028565 req-7054269d-6ded-4f86-9a83-e524d4c26191 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0816367 Nov 08 04:12:02.457845 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:12:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96a47f94-5ee9-4d01-affe-00bc8b04a7b8 x-openstack-request-id: req-96a47f94-5ee9-4d01-affe-00bc8b04a7b8 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:12:02.458319 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "name": "network-vif-plugged", "status": "completed", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:12:02.458833 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-96a47f94-5ee9-4d01-affe-00bc8b04a7b8 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:12:02.459312 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'code': 200} Nov 08 04:12:02.486431 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85bcfb8a-ef9f-40bd-b8d1-7a0f74028565 req-6ab3a5a6-6588-4efe-b478-a6944812e79d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463874 Nov 08 04:12:02.770994 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102f40fa-d8ef-4aac-8665-19f2f1f73fda req-5c2dce03-98f3-4467-9c14-11904a966b00 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:02.770994 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-102f40fa-d8ef-4aac-8665-19f2f1f73fda req-5c2dce03-98f3-4467-9c14-11904a966b00 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 944 time: 0.0510209 Nov 08 04:12:02.792696 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d997f4bb-f698-4538-b9ae-f08bec1d6ff6 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:12:02.841592 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-102f40fa-d8ef-4aac-8665-19f2f1f73fda req-7373427d-e7fb-4312-9e15-ca159fb18076 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0709927 Nov 08 04:12:02.851256 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06347a37-394b-425b-9d4c-3971a7831344 req-323ed1e6-006c-4341-b10f-81399db71878 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:02.853107 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06347a37-394b-425b-9d4c-3971a7831344 req-323ed1e6-006c-4341-b10f-81399db71878 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 1098 time: 0.0564518 Nov 08 04:12:02.904772 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06347a37-394b-425b-9d4c-3971a7831344 req-7d8eb040-948a-474a-8ca0-337e98e6c795 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435135 Nov 08 04:12:02.936859 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:12:02.940939 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:12:02.946729 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:03.015385 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd9eee3-ba07-4d03-b02c-0b4097767a0a req-25493cb1-48a6-490f-877e-15bd1b89b545 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:03.017731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ecd9eee3-ba07-4d03-b02c-0b4097767a0a req-25493cb1-48a6-490f-877e-15bd1b89b545 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0596490 Nov 08 04:12:03.037788 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:03.075941 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ecd9eee3-ba07-4d03-b02c-0b4097767a0a req-761aab0f-97de-4077-976b-d5865b62745e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515194 Nov 08 04:12:03.076292 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d997f4bb-f698-4538-b9ae-f08bec1d6ff6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:12:03.142904 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:03.193542 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:03.310259 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a738b0-d415-4923-9865-c530ab7ffe5d req-f78af503-1c8a-43f1-8ff0-f83a768225ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:03.310259 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7a738b0-d415-4923-9865-c530ab7ffe5d req-f78af503-1c8a-43f1-8ff0-f83a768225ab service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 1098 time: 0.0471559 Nov 08 04:12:03.386668 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a738b0-d415-4923-9865-c530ab7ffe5d req-939ee0d4-1ea8-48aa-ba62-69be826ef91e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:03.388264 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7a738b0-d415-4923-9865-c530ab7ffe5d req-939ee0d4-1ea8-48aa-ba62-69be826ef91e service neutron] 10.222.0.16 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 920 time: 0.0884361 Nov 08 04:12:03.432342 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7a738b0-d415-4923-9865-c530ab7ffe5d req-1654008d-7cab-48b3-93e9-0b0389078c14 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 HTTP/1.1" status: 200 len: 217 time: 0.0361564 Nov 08 04:12:03.482744 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a738b0-d415-4923-9865-c530ab7ffe5d req-e93af310-9ef3-4a9c-9385-8d4d069815a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:03.484174 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7a738b0-d415-4923-9865-c530ab7ffe5d req-e93af310-9ef3-4a9c-9385-8d4d069815a1 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=900a12a5-1baa-47e1-8b64-245dc70bc9f2 HTTP/1.1" status: 200 len: 859 time: 0.0446045 Nov 08 04:12:03.531852 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7a738b0-d415-4923-9865-c530ab7ffe5d req-268f48db-ae0e-4fc2-b69e-45b2322df2b4 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0367284 Nov 08 04:12:03.573943 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d99cb0e4-229a-476c-af7f-ed4dfe1ef30d req-fa658ed6-0985-4afc-a6a3-679eadd0b720 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:03.575927 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d99cb0e4-229a-476c-af7f-ed4dfe1ef30d req-fa658ed6-0985-4afc-a6a3-679eadd0b720 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0897455 Nov 08 04:12:03.673078 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d99cb0e4-229a-476c-af7f-ed4dfe1ef30d req-c5bf5826-bbb1-4bb7-a8d2-ddc117ba7b14 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0703185 Nov 08 04:12:03.675042 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7a738b0-d415-4923-9865-c530ab7ffe5d req-c27cd3d5-4f50-412e-aa84-d6e315dd4ad8 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1334603 Nov 08 04:12:03.787113 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7a738b0-d415-4923-9865-c530ab7ffe5d req-6685a2ab-9f75-4f90-9715-ff814357dc5e service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988715 Nov 08 04:12:03.840485 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50332) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:03.944559 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9458bd85-5ff2-42d0-b09c-889dac4ed98f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:03.965179 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59a56ff2-e0db-45ae-87aa-d9ae96a80491 req-bdcb07e2-a64f-43fa-9e43-013cfea2fc1e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:03.967254 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-59a56ff2-e0db-45ae-87aa-d9ae96a80491 req-bdcb07e2-a64f-43fa-9e43-013cfea2fc1e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0551348 Nov 08 04:12:04.020327 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-59a56ff2-e0db-45ae-87aa-d9ae96a80491 req-643d9835-1a19-4351-99c0-9bdbb9e4661b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471904 Nov 08 04:12:04.022230 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9458bd85-5ff2-42d0-b09c-889dac4ed98f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:04.073771 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9458bd85-5ff2-42d0-b09c-889dac4ed98f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:04.112482 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-9458bd85-5ff2-42d0-b09c-889dac4ed98f admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=0651846394344142a6028989d60c6028&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2708220 Nov 08 04:12:04.113262 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9458bd85-5ff2-42d0-b09c-889dac4ed98f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=003ab8e4-0278-4a99-b1ce-e928057484f6,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:04.115659 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50346) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:04.173375 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-63c13bae-8876-41ef-b919-c4455c67fe3b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:04.214019 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-63c13bae-8876-41ef-b919-c4455c67fe3b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:04.240912 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-899aa388-5b47-4848-ae20-5c9bf15b84f9 req-16f491f3-0af8-4da1-9114-55f09c899cbb tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:04.242892 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-899aa388-5b47-4848-ae20-5c9bf15b84f9 req-16f491f3-0af8-4da1-9114-55f09c899cbb tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0800848 Nov 08 04:12:04.300659 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-899aa388-5b47-4848-ae20-5c9bf15b84f9 req-9d7a1f87-dd78-4cfb-bc8c-485596c4ab8c tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482378 Nov 08 04:12:04.362363 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-63c13bae-8876-41ef-b919-c4455c67fe3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:04.365215 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-63c13bae-8876-41ef-b919-c4455c67fe3b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:04.366655 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-63c13bae-8876-41ef-b919-c4455c67fe3b admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/003ab8e4-0278-4a99-b1ce-e928057484f6 HTTP/1.1" status: 204 len: 168 time: 0.2498906 Nov 08 04:12:04.375026 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63c13bae-8876-41ef-b919-c4455c67fe3b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=003ab8e4-0278-4a99-b1ce-e928057484f6,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:04.460777 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '12c1d323-bd37-4a14-be65-7a504c81950a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:12:04.463583 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-050fe5f5-87a4-4834-91ab-167671828763" -d '{"events": [{"server_uuid": "12c1d323-bd37-4a14-be65-7a504c81950a", "name": "network-vif-plugged", "status": "completed", "tag": "d997f4bb-f698-4538-b9ae-f08bec1d6ff6"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:12:04.498385 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:12:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91610352-3c89-420b-af7e-2d1481c1a30e x-openstack-request-id: req-91610352-3c89-420b-af7e-2d1481c1a30e {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:12:04.498721 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "12c1d323-bd37-4a14-be65-7a504c81950a", "name": "network-vif-plugged", "status": "completed", "tag": "d997f4bb-f698-4538-b9ae-f08bec1d6ff6", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:12:04.498977 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-91610352-3c89-420b-af7e-2d1481c1a30e {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:12:04.499367 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '12c1d323-bd37-4a14-be65-7a504c81950a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6', 'code': 200} Nov 08 04:12:04.800493 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7143418-15df-463c-b902-89e48ca5e8c5 req-18ad38a4-9de6-451e-8d47-b56fc2515381 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:04.801989 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7143418-15df-463c-b902-89e48ca5e8c5 req-18ad38a4-9de6-451e-8d47-b56fc2515381 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0505888 Nov 08 04:12:04.850993 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7143418-15df-463c-b902-89e48ca5e8c5 req-f6413141-e36e-4923-a605-e6a6115dadef tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423763 Nov 08 04:12:04.963550 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ee68cac-386b-42a1-8c0a-97acad80b2c3 req-2a86145d-193c-40a4-8079-cf3b244c2ab1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:04.965039 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8ee68cac-386b-42a1-8c0a-97acad80b2c3 req-2a86145d-193c-40a4-8079-cf3b244c2ab1 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 1098 time: 0.0703552 Nov 08 04:12:05.064467 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50378) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:05.078732 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ddd25f4a-cc71-4f79-b1b5-8b2b0415237a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:05.167932 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ddd25f4a-cc71-4f79-b1b5-8b2b0415237a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:05.184747 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f63edc5-2423-44d5-8231-b63510986522 req-04cc72ac-c99d-467a-82ea-4a80f3ad8f98 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:05.186158 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9f63edc5-2423-44d5-8231-b63510986522 req-04cc72ac-c99d-467a-82ea-4a80f3ad8f98 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.2596729 Nov 08 04:12:05.195405 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50384) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:05.201389 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-619c0248-3bf6-438b-ac39-b5e5262166f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'floatingip': {'port_id': 'e6483e56-c377-4575-bd34-b26a5c2bf382'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:12:05.240915 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8ee68cac-386b-42a1-8c0a-97acad80b2c3 req-7af148b9-6072-49d9-b37a-29bbaff0e406 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2672682 Nov 08 04:12:05.254607 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd377356-abe7-4403-a39a-f334bd7c3eec req-6a975511-079d-4074-94f6-42d7e0c17236 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:05.255874 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dd377356-abe7-4403-a39a-f334bd7c3eec req-6a975511-079d-4074-94f6-42d7e0c17236 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0688038 Nov 08 04:12:05.271415 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ddd25f4a-cc71-4f79-b1b5-8b2b0415237a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:05.300679 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-619c0248-3bf6-438b-ac39-b5e5262166f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:05.303613 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dd377356-abe7-4403-a39a-f334bd7c3eec req-d0dc8673-f0bf-47db-b13b-d1332e7fd010 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413556 Nov 08 04:12:05.353457 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddd25f4a-cc71-4f79-b1b5-8b2b0415237a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=273db12a-2226-4ac1-9c0d-3c54b3964870,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:05.400069 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-ddd25f4a-cc71-4f79-b1b5-8b2b0415237a admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=69e71b7cd87c41b2b1c3484bb5047f5a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3344316 Nov 08 04:12:05.405954 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50396) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:05.457691 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f36c7dd2-59ce-4327-8218-4a578c7ddab5 req-0b49195f-9e9c-48ac-a7d5-2c64e7a4c67a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:05.460329 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50400) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:05.462948 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f36c7dd2-59ce-4327-8218-4a578c7ddab5 req-0b49195f-9e9c-48ac-a7d5-2c64e7a4c67a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0655842 Nov 08 04:12:05.501252 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-37d2cf9f-be9f-461e-a87e-b878e136e082 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:05.516066 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f36c7dd2-59ce-4327-8218-4a578c7ddab5 req-c6da5c35-8784-4e68-a1ce-88cdae482003 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477469 Nov 08 04:12:05.572274 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-37d2cf9f-be9f-461e-a87e-b878e136e082 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:05.647911 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b05cf41e-d343-4b4f-83bb-4634630d8d41 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:05.791527 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-37d2cf9f-be9f-461e-a87e-b878e136e082 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:05.793991 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-37d2cf9f-be9f-461e-a87e-b878e136e082 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:05.795143 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-37d2cf9f-be9f-461e-a87e-b878e136e082 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/273db12a-2226-4ac1-9c0d-3c54b3964870 HTTP/1.1" status: 204 len: 168 time: 0.3880646 Nov 08 04:12:05.846197 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37d2cf9f-be9f-461e-a87e-b878e136e082 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=273db12a-2226-4ac1-9c0d-3c54b3964870,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:06.221820 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b05cf41e-d343-4b4f-83bb-4634630d8d41 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:06.287873 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b05cf41e-d343-4b4f-83bb-4634630d8d41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:06.369955 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-b05cf41e-d343-4b4f-83bb-4634630d8d41 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=694cd3cac26c465598e6e74abbdcc5e7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9062736 Nov 08 04:12:06.372430 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-619c0248-3bf6-438b-ac39-b5e5262166f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:06.372699 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50448) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:06.373361 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b05cf41e-d343-4b4f-83bb-4634630d8d41 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=092718f7-6d00-498d-b359-e35bebf632fe,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:06.468260 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-619c0248-3bf6-438b-ac39-b5e5262166f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:06.470202 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-327af1c9-1704-42e6-8be2-55832a4e1eeb req-5b24f54a-ac11-4d7a-b41e-9936cd1e2ff4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:06.472308 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-327af1c9-1704-42e6-8be2-55832a4e1eeb req-5b24f54a-ac11-4d7a-b41e-9936cd1e2ff4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0836811 Nov 08 04:12:06.472732 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b7b56fda-e6f2-445d-b2e4-8a91754d7660 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:06.506792 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b7b56fda-e6f2-445d-b2e4-8a91754d7660 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:06.555884 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-327af1c9-1704-42e6-8be2-55832a4e1eeb req-ce69682a-6c84-4144-9c0c-2a13524baaa1 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0734899 Nov 08 04:12:06.589614 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.l3_db [None req-619c0248-3bf6-438b-ac39-b5e5262166f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Floating IP 52ece660-79a3-4c95-93a4-3b91caf2ffd7 associated. External IP: 172.27.2.56, port: e6483e56-c377-4575-bd34-b26a5c2bf382. Nov 08 04:12:06.672277 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b743fcf2-5ee6-4837-835a-b45f4ef661b6 req-401bf899-c8ab-4f77-bcde-eb95b647123e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:06.674186 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b743fcf2-5ee6-4837-835a-b45f4ef661b6 req-401bf899-c8ab-4f77-bcde-eb95b647123e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0583394 Nov 08 04:12:06.699640 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b7b56fda-e6f2-445d-b2e4-8a91754d7660 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:06.702828 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b7b56fda-e6f2-445d-b2e4-8a91754d7660 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:06.706305 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b7b56fda-e6f2-445d-b2e4-8a91754d7660 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/092718f7-6d00-498d-b359-e35bebf632fe HTTP/1.1" status: 204 len: 168 time: 0.3297362 Nov 08 04:12:06.718285 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b56fda-e6f2-445d-b2e4-8a91754d7660 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=092718f7-6d00-498d-b359-e35bebf632fe,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:06.745731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b743fcf2-5ee6-4837-835a-b45f4ef661b6 req-603d67b6-afd1-4c32-b29a-2d153b42e1c1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634804 Nov 08 04:12:06.841022 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-619c0248-3bf6-438b-ac39-b5e5262166f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Router 02bab738-cfe2-4e4a-8864-2604a23990ee has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:12:06.952487 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-619c0248-3bf6-438b-ac39-b5e5262166f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:12:06.958213 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-619c0248-3bf6-438b-ac39-b5e5262166f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:06.972349 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] Sync routers for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:12:06.987328 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:12:06.991758 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:06.991897 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-619c0248-3bf6-438b-ac39-b5e5262166f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "PUT /v2.0/floatingips/52ece660-79a3-4c95-93a4-3b91caf2ffd7 HTTP/1.1" status: 200 len: 990 time: 1.7917728 Nov 08 04:12:06.991897 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:12:06.991897 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd41c9be-ff5f-40a3-aab9-fb48871aebff" -d '{"events": [{"name": "network-changed", "server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:12:07.061832 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:12:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-473a211a-d676-4f1f-8786-74d26bf96110 x-openstack-request-id: req-473a211a-d676-4f1f-8786-74d26bf96110 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:12:07.062275 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:12:07.062649 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-473a211a-d676-4f1f-8786-74d26bf96110 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:12:07.063191 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'status': 'completed', 'code': 200} Nov 08 04:12:07.141448 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:12:07.317791 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-37fe303d-9523-43eb-b546-e03315c1e68d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:07.317791 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-37fe303d-9523-43eb-b546-e03315c1e68d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 1098 time: 0.0646091 Nov 08 04:12:07.432890 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50522) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:07.452714 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f727d4d0-973a-4fe2-988b-d36da3fcdadd admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:07.463339 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-cf9de7a5-bd5c-49f4-8eee-c0f7451b6455 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:07.464771 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-cf9de7a5-bd5c-49f4-8eee-c0f7451b6455 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 918 time: 0.1164248 Nov 08 04:12:07.505575 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '52ece660-79a3-4c95-93a4-3b91caf2ffd7', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'floating_ip_address': '172.27.2.56', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'port_id': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 110, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'mac_address': 'fa:16:3e:b2:b0:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:11:35Z', 'updated_at': '2021-11-08T04:12:06Z', 'revision_number': 1, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:07.539957 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] Checking router: 02bab738-cfe2-4e4a-8864-2604a23990ee for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:12:07.545045 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f727d4d0-973a-4fe2-988b-d36da3fcdadd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:07.548292 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:12:07.548905 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:07.588657 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-57c3ce93-742d-42ec-8478-9279c03bbf0f service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e6483e56-c377-4575-bd34-b26a5c2bf382 HTTP/1.1" status: 200 len: 998 time: 0.1001770 Nov 08 04:12:07.669790 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:12:07.686800 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-cfe88803-5558-42d5-bfb8-bad493604cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:07.688230 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-cfe88803-5558-42d5-bfb8-bad493604cb0 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.0755754 Nov 08 04:12:07.704474 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37bbd7e2-f057-481c-a2c1-158d19faf2c7 req-01ff150d-5fe2-48a9-87e7-c9b209a42736 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:07.704649 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f727d4d0-973a-4fe2-988b-d36da3fcdadd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:07.706281 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-37bbd7e2-f057-481c-a2c1-158d19faf2c7 req-01ff150d-5fe2-48a9-87e7-c9b209a42736 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0626121 Nov 08 04:12:07.744142 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f727d4d0-973a-4fe2-988b-d36da3fcdadd admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=5404da96c4d54e28980c15f698ca85b2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3105304 Nov 08 04:12:07.745235 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f727d4d0-973a-4fe2-988b-d36da3fcdadd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79936046-b2f9-421a-b126-c7174b9ea1bc,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:07.755299 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50526) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:07.875939 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-7dff0104-a5b5-4c69-b56a-855accd7354d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:07.877522 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-7dff0104-a5b5-4c69-b56a-855accd7354d service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1639490 Nov 08 04:12:07.880901 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-37bbd7e2-f057-481c-a2c1-158d19faf2c7 req-93aaa3bc-f899-4d02-a3b9-9be1532b74d7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1590748 Nov 08 04:12:07.920182 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '52ece660-79a3-4c95-93a4-3b91caf2ffd7', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'floating_ip_address': '172.27.2.56', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'port_id': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 110, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'mac_address': 'fa:16:3e:b2:b0:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:11:35Z', 'updated_at': '2021-11-08T04:12:06Z', 'revision_number': 1, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:07.931587 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9722601a-7022-4061-adf4-3018dab2406e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:07.942508 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e13894c7-8cdf-4bbb-b580-af131c2b3ce3 req-1bbd9526-d752-4ff4-9fcd-92293a3f3395 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:07.944121 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e13894c7-8cdf-4bbb-b580-af131c2b3ce3 req-1bbd9526-d752-4ff4-9fcd-92293a3f3395 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.1090460 Nov 08 04:12:07.968740 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-694562f9-e828-4205-9757-f6ceb43e7d44 None None] The sync data for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi is: [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '52ece660-79a3-4c95-93a4-3b91caf2ffd7', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'floating_ip_address': '172.27.2.56', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'port_id': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 110, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'mac_address': 'fa:16:3e:b2:b0:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:11:35Z', 'updated_at': '2021-11-08T04:12:06Z', 'revision_number': 1, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:12:08.017228 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9722601a-7022-4061-adf4-3018dab2406e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:08.124415 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-23231c6f-e68b-4f6e-9d5b-e207c4141198 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2259576 Nov 08 04:12:08.128898 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e13894c7-8cdf-4bbb-b580-af131c2b3ce3 req-b63f584a-d2bd-4f7d-888c-8e85f812ac74 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1504540 Nov 08 04:12:08.140680 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f49ff60-f986-4187-ba85-300dc8539a8b req-f6f50a91-cf1a-4493-ae5e-42dc3d816343 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:08.140680 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9f49ff60-f986-4187-ba85-300dc8539a8b req-f6f50a91-cf1a-4493-ae5e-42dc3d816343 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1541741 Nov 08 04:12:08.155935 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50542) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:08.181334 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-23f9950f-7f36-4295-baa4-a4222a06fa63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'floatingip': {'port_id': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:12:08.221729 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-23f9950f-7f36-4295-baa4-a4222a06fa63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:08.313955 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd41c9be-ff5f-40a3-aab9-fb48871aebff req-93120f42-1a8f-4963-9220-9386bf03069a service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1723454 Nov 08 04:12:08.345981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9722601a-7022-4061-adf4-3018dab2406e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:08.351921 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9722601a-7022-4061-adf4-3018dab2406e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:08.353057 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-9722601a-7022-4061-adf4-3018dab2406e admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/79936046-b2f9-421a-b126-c7174b9ea1bc HTTP/1.1" status: 204 len: 168 time: 0.5963688 Nov 08 04:12:08.382175 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9722601a-7022-4061-adf4-3018dab2406e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79936046-b2f9-421a-b126-c7174b9ea1bc,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:08.416669 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9f80e8e-b2a4-4836-86c7-373cf5a0ad24 None None] New status for floating IP 52ece660-79a3-4c95-93a4-3b91caf2ffd7: ACTIVE {{(pid=101666) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:12:08.760102 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50562) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:08.772887 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-23f9950f-7f36-4295-baa4-a4222a06fa63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:08.868470 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-23f9950f-7f36-4295-baa4-a4222a06fa63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:08.885283 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6758323b-c1d1-4495-975a-2d2cbbf26aab admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:08.978964 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.l3_db [None req-23f9950f-7f36-4295-baa4-a4222a06fa63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Floating IP 35b8a973-872d-4c57-91f8-7460a16e0c2e associated. External IP: 172.27.2.48, port: d997f4bb-f698-4538-b9ae-f08bec1d6ff6. Nov 08 04:12:08.999731 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6758323b-c1d1-4495-975a-2d2cbbf26aab admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:09.050524 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6758323b-c1d1-4495-975a-2d2cbbf26aab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:09.094306 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-6758323b-c1d1-4495-975a-2d2cbbf26aab admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=8c06e6cca27b4253accc2716e6b1f327&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3303413 Nov 08 04:12:09.094451 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50584) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:09.100427 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6758323b-c1d1-4495-975a-2d2cbbf26aab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=113eb0ee-3cb0-455a-9aa0-e28206492e2f,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:09.155981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4e11b5c7-3c6c-4e20-92cb-78af72d93397 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:09.185273 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4e11b5c7-3c6c-4e20-92cb-78af72d93397 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:09.231117 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-23f9950f-7f36-4295-baa4-a4222a06fa63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Router 38c2ccdd-af72-475c-872c-b75630dd8639 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:12:09.308647 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00e8d2ef-5eb5-467a-ab68-f36f25c81ca5 req-191e5392-2391-4d49-8bc4-9a11d7721b7d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:09.312566 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00e8d2ef-5eb5-467a-ab68-f36f25c81ca5 req-191e5392-2391-4d49-8bc4-9a11d7721b7d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0665994 Nov 08 04:12:09.358759 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-23f9950f-7f36-4295-baa4-a4222a06fa63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:12:09.364040 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-23f9950f-7f36-4295-baa4-a4222a06fa63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:09.366337 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00e8d2ef-5eb5-467a-ab68-f36f25c81ca5 req-0de3c7dc-5e38-4322-9323-97b0fb3a960a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455747 Nov 08 04:12:09.371282 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] Sync routers for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:12:09.382892 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:12:09.383772 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:09.397364 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4e11b5c7-3c6c-4e20-92cb-78af72d93397 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:09.403927 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4e11b5c7-3c6c-4e20-92cb-78af72d93397 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:09.405722 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-4e11b5c7-3c6c-4e20-92cb-78af72d93397 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/113eb0ee-3cb0-455a-9aa0-e28206492e2f HTTP/1.1" status: 204 len: 168 time: 0.3099372 Nov 08 04:12:09.412417 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-23f9950f-7f36-4295-baa4-a4222a06fa63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "PUT /v2.0/floatingips/35b8a973-872d-4c57-91f8-7460a16e0c2e HTTP/1.1" status: 200 len: 990 time: 1.2548935 Nov 08 04:12:09.414594 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '12c1d323-bd37-4a14-be65-7a504c81950a', 'tag': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:12:09.417917 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e11b5c7-3c6c-4e20-92cb-78af72d93397 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=113eb0ee-3cb0-455a-9aa0-e28206492e2f,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:09.418439 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08089ee8-226b-4554-89b0-fda3b2765aa9" -d '{"events": [{"name": "network-changed", "server_uuid": "12c1d323-bd37-4a14-be65-7a504c81950a", "tag": "d997f4bb-f698-4538-b9ae-f08bec1d6ff6"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:12:09.702208 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:12:09.720805 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:12:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b2bb86a6-1d25-4994-808b-3f7572e2816c x-openstack-request-id: req-b2bb86a6-1d25-4994-808b-3f7572e2816c {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:12:09.721282 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "12c1d323-bd37-4a14-be65-7a504c81950a", "tag": "d997f4bb-f698-4538-b9ae-f08bec1d6ff6", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:12:09.721622 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-b2bb86a6-1d25-4994-808b-3f7572e2816c {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:12:09.722079 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '12c1d323-bd37-4a14-be65-7a504c81950a', 'tag': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6', 'status': 'completed', 'code': 200} Nov 08 04:12:09.860805 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-3b2d494c-1f7a-4484-84e3-437df40d6342 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:09.863313 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-3b2d494c-1f7a-4484-84e3-437df40d6342 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 1098 time: 0.0447702 Nov 08 04:12:09.980211 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '35b8a973-872d-4c57-91f8-7460a16e0c2e', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'floating_ip_address': '172.27.2.48', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'port_id': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 122, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'mac_address': 'fa:16:3e:9c:ca:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '12c1d323-bd37-4a14-be65-7a504c81950a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:11:39Z', 'updated_at': '2021-11-08T04:12:08Z', 'revision_number': 1, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:10.010007 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] Checking router: 38c2ccdd-af72-475c-872c-b75630dd8639 for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:12:10.021663 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:12:10.026201 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:11:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:10.068092 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-d8fcce6e-bdee-445d-8a30-57eb68d17cd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:10.069711 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-d8fcce6e-bdee-445d-8a30-57eb68d17cd2 service neutron] 10.222.0.16 "GET /v2.0/networks?id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f HTTP/1.1" status: 200 len: 912 time: 0.1895130 Nov 08 04:12:10.142936 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:12:10.162759 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-e2641b1c-cce9-4fba-87ba-15993100f666 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:10.164618 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-e2641b1c-cce9-4fba-87ba-15993100f666 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/networks?id=1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 200 len: 814 time: 0.1691883 Nov 08 04:12:10.182904 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-e4faf95a-4537-4ddb-a13e-0af1223f99ef service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d997f4bb-f698-4538-b9ae-f08bec1d6ff6 HTTP/1.1" status: 200 len: 998 time: 0.0924788 Nov 08 04:12:10.186474 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-c5af40cc-ecee-48f8-bc0a-79e7bc6447b4 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/quotas/f3ecedce4bce4764a6bd2e0cc60c4955 HTTP/1.1" status: 200 len: 375 time: 0.0120299 Nov 08 04:12:10.269845 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-751ce1c8-edfb-4b6a-834f-678a5b0b9b83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:10.271351 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-751ce1c8-edfb-4b6a-834f-678a5b0b9b83 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=1158e941-c129-49d0-9b8b-ba72d0ef6717 HTTP/1.1" status: 200 len: 850 time: 0.0681219 Nov 08 04:12:10.275445 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-97c2d4ff-1012-4c18-b252-c372bb91d4ee tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0825369 Nov 08 04:12:10.388307 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '35b8a973-872d-4c57-91f8-7460a16e0c2e', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'floating_ip_address': '172.27.2.48', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'port_id': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 122, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'mac_address': 'fa:16:3e:9c:ca:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '12c1d323-bd37-4a14-be65-7a504c81950a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:11:39Z', 'updated_at': '2021-11-08T04:12:08Z', 'revision_number': 1, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:10.391462 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-ce46206b-1176-482f-87b7-a09b24ba94f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:10.392942 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-ce46206b-1176-482f-87b7-a09b24ba94f9 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0967562 Nov 08 04:12:10.415104 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbbcce3e-491a-4823-94a5-03ae0d99678f None None] The sync data for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi is: [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '35b8a973-872d-4c57-91f8-7460a16e0c2e', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'floating_ip_address': '172.27.2.48', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'port_id': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 122, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'mac_address': 'fa:16:3e:9c:ca:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '12c1d323-bd37-4a14-be65-7a504c81950a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:11:39Z', 'updated_at': '2021-11-08T04:12:08Z', 'revision_number': 1, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:12:10.419358 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-c3b8120a-8397-4659-9565-03ac87d5e9d5 service neutron] 10.222.0.21 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1339490 Nov 08 04:12:10.499088 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50644) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:10.528375 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-69c650ca-6087-4e6b-af75-d1fe840d5025 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:10.683830 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-039d5459-b4a0-49fd-969c-9ed62413c50e req-20c1f87f-b4c2-416d-8713-7a6369b9cfeb tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:10.683830 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-039d5459-b4a0-49fd-969c-9ed62413c50e req-20c1f87f-b4c2-416d-8713-7a6369b9cfeb tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.1349342 Nov 08 04:12:10.683830 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-d13e1921-f817-48c1-8ba3-b125e9a26796 service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2529311 Nov 08 04:12:10.683830 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-b8574818-caa0-4c48-8dfc-ff3546f3ebcd service neutron] 10.222.0.21 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2450647 Nov 08 04:12:10.702444 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-69c650ca-6087-4e6b-af75-d1fe840d5025 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:10.761946 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-69c650ca-6087-4e6b-af75-d1fe840d5025 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:10.788449 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c47a2bb-b9c2-4df3-abb3-58b77bab0ad8 None None] New status for floating IP 35b8a973-872d-4c57-91f8-7460a16e0c2e: ACTIVE {{(pid=101666) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:12:10.811837 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-69c650ca-6087-4e6b-af75-d1fe840d5025 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=fd2d578f9ea1472ea3f1535e1a9f5a0d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3084602 Nov 08 04:12:10.812911 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50654) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:10.825772 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c650ca-6087-4e6b-af75-d1fe840d5025 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3b0f71c-1105-4136-8e12-108017d6b7f8,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:10.872773 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0bf622c1-f4dc-46f5-9d7e-02b803fafdf1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:10.899517 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0bf622c1-f4dc-46f5-9d7e-02b803fafdf1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:10.918518 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-08089ee8-226b-4554-89b0-fda3b2765aa9 req-85de5489-2d5e-4df7-bc42-602ccbdb0ab8 service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2193837 Nov 08 04:12:10.924927 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-039d5459-b4a0-49fd-969c-9ed62413c50e req-a8dc4218-4cec-4055-83bf-fde8ee2be0b6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2432017 Nov 08 04:12:11.056654 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0bf622c1-f4dc-46f5-9d7e-02b803fafdf1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:11.059272 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0bf622c1-f4dc-46f5-9d7e-02b803fafdf1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:11.062532 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-0bf622c1-f4dc-46f5-9d7e-02b803fafdf1 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/d3b0f71c-1105-4136-8e12-108017d6b7f8 HTTP/1.1" status: 204 len: 168 time: 0.2465491 Nov 08 04:12:11.068443 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf622c1-f4dc-46f5-9d7e-02b803fafdf1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3b0f71c-1105-4136-8e12-108017d6b7f8,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:11.234267 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7761a0c3-18f3-4ecf-a676-1d3f0ca068c6 req-96e625b9-b2e5-42f5-81ab-22ba6bfce50f tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 210 time: 0.0371957 Nov 08 04:12:12.047007 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236074a1-31eb-424e-8249-e2a61078b96f req-f11b261a-61d1-40a9-9432-de7d34269ce6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:12.048461 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-236074a1-31eb-424e-8249-e2a61078b96f req-f11b261a-61d1-40a9-9432-de7d34269ce6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0498571 Nov 08 04:12:12.097036 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-236074a1-31eb-424e-8249-e2a61078b96f req-d947a82b-4571-4160-bfb5-cc643f9fdc28 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426424 Nov 08 04:12:12.416738 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a476fd91-ea53-4355-859d-761368d70169 req-a0b9ca23-2461-4c72-aa5a-9f7889aec345 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 210 time: 0.0264902 Nov 08 04:12:12.725712 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f6b4d1e8-ca33-4e4a-9754-805cf1e762cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:13.030821 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50744) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:13.139956 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-1778fd7f-d1dd-4014-b49f-d83d0709faf4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:13.220681 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-1778fd7f-d1dd-4014-b49f-d83d0709faf4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:13.224582 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90bde33d-e875-411a-82df-407f3d63857c req-5869d53b-01ec-4f57-baa5-82edf909d2c2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:13.226053 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-90bde33d-e875-411a-82df-407f3d63857c req-5869d53b-01ec-4f57-baa5-82edf909d2c2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0544064 Nov 08 04:12:13.274183 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-90bde33d-e875-411a-82df-407f3d63857c req-11e60550-01ea-4922-ba76-e24809c51152 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422046 Nov 08 04:12:13.284918 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-1778fd7f-d1dd-4014-b49f-d83d0709faf4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:13.326838 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-1778fd7f-d1dd-4014-b49f-d83d0709faf4 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=dd0c3364b412435a8b242cf9d870cc4c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2948735 Nov 08 04:12:13.327708 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1778fd7f-d1dd-4014-b49f-d83d0709faf4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bffa0266-93a3-4358-b6ae-a0fcb402f466,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:13.329466 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50752) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:13.382207 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d7438309-757a-4759-aa85-70a91c4c8333 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:13.407674 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d7438309-757a-4759-aa85-70a91c4c8333 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:13.565192 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d7438309-757a-4759-aa85-70a91c4c8333 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:13.571687 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d7438309-757a-4759-aa85-70a91c4c8333 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:13.571687 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-d7438309-757a-4759-aa85-70a91c4c8333 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/bffa0266-93a3-4358-b6ae-a0fcb402f466 HTTP/1.1" status: 204 len: 168 time: 0.2386618 Nov 08 04:12:13.634082 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7438309-757a-4759-aa85-70a91c4c8333 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bffa0266-93a3-4358-b6ae-a0fcb402f466,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:13.667339 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-05103a3c-ba83-404f-8344-a8870d68aa9f req-aeb31341-cd92-46ba-b56e-9e2992c5a496 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 210 time: 0.0368552 Nov 08 04:12:13.698148 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-4bcd7b6c-9da1-4346-9f05-4b0629ca0704 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:13.699592 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-4bcd7b6c-9da1-4346-9f05-4b0629ca0704 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "GET /v2.0/networks?id=1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 200 len: 814 time: 0.1547337 Nov 08 04:12:13.738008 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Request body: {'port': {'device_id': '42fd1d8f-82f7-4a08-9078-ff02a30df4e6', 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc', 'admin_state_up': True, 'tenant_id': 'f3ecedce4bce4764a6bd2e0cc60c4955'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:12:13.955832 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Made reservation on behalf of f3ecedce4bce4764a6bd2e0cc60c4955 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:12:13.959411 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.194176 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50776) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:14.207774 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-71617d2b-d67d-40c5-b5aa-12de5a9f9d1c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.281277 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Allocated IP 172.20.0.6 (1516eeae-19de-448e-9ebd-952b54f99dcc/59ccbcae-2516-4cc7-9077-478845e3e1f2/946fbfcb-ea3d-434f-9d42-bd6883f13e5d) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:12:14.290245 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-71617d2b-d67d-40c5-b5aa-12de5a9f9d1c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.359057 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-71617d2b-d67d-40c5-b5aa-12de5a9f9d1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.400342 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-71617d2b-d67d-40c5-b5aa-12de5a9f9d1c admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=99da9d7700464a3a93f84946d47d7613&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2049351 Nov 08 04:12:14.401689 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71617d2b-d67d-40c5-b5aa-12de5a9f9d1c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1aa53c71-ec2b-438f-8c36-115de8f52f30,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:14.404132 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50784) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:14.444125 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04472e6-7e0b-48da-ab76-4163e3445b54 req-2dde562c-18aa-421e-8e50-81db17955615 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:14.450926 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b04472e6-7e0b-48da-ab76-4163e3445b54 req-2dde562c-18aa-421e-8e50-81db17955615 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0946274 Nov 08 04:12:14.462928 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9ea7bb61-8166-444b-b2e3-e0faf35ba8aa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.490625 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9ea7bb61-8166-444b-b2e3-e0faf35ba8aa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.510472 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.529928 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b04472e6-7e0b-48da-ab76-4163e3445b54 req-af79bfae-ffbe-4a8e-ba31-650f01e8e49a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783350 Nov 08 04:12:14.625137 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9ea7bb61-8166-444b-b2e3-e0faf35ba8aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.625571 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.627951 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9ea7bb61-8166-444b-b2e3-e0faf35ba8aa admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.629152 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-9ea7bb61-8166-444b-b2e3-e0faf35ba8aa admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/1aa53c71-ec2b-438f-8c36-115de8f52f30 HTTP/1.1" status: 204 len: 168 time: 0.2238717 Nov 08 04:12:14.637394 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea7bb61-8166-444b-b2e3-e0faf35ba8aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1aa53c71-ec2b-438f-8c36-115de8f52f30,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:14.669597 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Network 1516eeae-19de-448e-9ebd-952b54f99dcc is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:12:14.674763 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:12:14.678577 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:12:14.684171 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:14.684783 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.689688 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['f790fbae-e681-4e01-b1a4-67513d491300'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:12:14.691031 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Pushing event updated for resources: {'Port': ['ID=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:14.787078 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-905f35db-a19a-40d4-9662-c2516d55ef39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0533288 Nov 08 04:12:14.823330 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Request body: {'port': {'device_id': '42fd1d8f-82f7-4a08-9078-ff02a30df4e6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:12:14.900809 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f120f09b-2fe9-4f83-b37b-01e27587682f req-3278c58a-cbd6-4766-b57d-70ae1d5e1e7e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:14.902592 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f120f09b-2fe9-4f83-b37b-01e27587682f req-3278c58a-cbd6-4766-b57d-70ae1d5e1e7e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 931 time: 0.1084762 Nov 08 04:12:14.910532 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:14.992767 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f120f09b-2fe9-4f83-b37b-01e27587682f req-6d973af9-1ae1-4eb0-9cf1-49d461e003b1 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800035 Nov 08 04:12:15.137090 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-29914cad-346a-4159-b7cf-b0d01639a3a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:15.230005 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 946fbfcb-ea3d-434f-9d42-bd6883f13e5d {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:12:15.235412 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:15.249752 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Transition to ACTIVE for port object 946fbfcb-ea3d-434f-9d42-bd6883f13e5d will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:12:15.330752 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:15.385553 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Pushing event updated for resources: {'Port': ['ID=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:15.411300 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.411646 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.411977 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.412306 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.412633 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.412957 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.413344 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.413672 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.413996 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.414344 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.414745 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.415001 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:15.426765 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Attempting to bind port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:12:15.427105 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Attempting to bind port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:12:15.427427 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Attempting to bind port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d on network 1516eeae-19de-448e-9ebd-952b54f99dcc {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:12:15.432352 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d on network 1516eeae-19de-448e-9ebd-952b54f99dcc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:12:15.432529 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Attempting to bind port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d on network 1516eeae-19de-448e-9ebd-952b54f99dcc {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:12:15.437264 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 11, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:12:15.437530 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Checking segment: {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:12:15.437908 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Bound using segment: {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:12:15.438324 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Bound port: 946fbfcb-ea3d-434f-9d42-bd6883f13e5d, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:12:15.438711 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:15.501682 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] For port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:12:15.508624 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] For port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:12:15.621607 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:15.670740 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:15.671358 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:15.672862 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] 10.222.0.16 "PUT /v2.0/ports/946fbfcb-ea3d-434f-9d42-bd6883f13e5d HTTP/1.1" status: 200 len: 1093 time: 0.8549349 Nov 08 04:12:15.675168 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '42fd1d8f-82f7-4a08-9078-ff02a30df4e6', 'tag': '946fbfcb-ea3d-434f-9d42-bd6883f13e5d'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:12:15.677452 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-880dacdd-8029-4729-9191-5ce5a5e0060a" -d '{"events": [{"name": "network-changed", "server_uuid": "42fd1d8f-82f7-4a08-9078-ff02a30df4e6", "tag": "946fbfcb-ea3d-434f-9d42-bd6883f13e5d"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:12:15.718676 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d27745-2f58-4a6b-a186-0c18124180bf req-46e68411-e0f1-45df-b80a-9be8d9cc3ed8 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:15.720204 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-56d27745-2f58-4a6b-a186-0c18124180bf req-46e68411-e0f1-45df-b80a-9be8d9cc3ed8 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.1111083 Nov 08 04:12:15.721561 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d7bb6a-9a20-49f6-8c4f-b691a0186603 service neutron] Pushing event updated for resources: {'Port': ['ID=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:15.732257 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:12:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c30022b-5f91-4ed4-a465-1bc9dc5a12ba x-openstack-request-id: req-4c30022b-5f91-4ed4-a465-1bc9dc5a12ba {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:12:15.732545 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "42fd1d8f-82f7-4a08-9078-ff02a30df4e6", "tag": "946fbfcb-ea3d-434f-9d42-bd6883f13e5d", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:12:15.733219 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-4c30022b-5f91-4ed4-a465-1bc9dc5a12ba {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:12:15.733219 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '42fd1d8f-82f7-4a08-9078-ff02a30df4e6', 'tag': '946fbfcb-ea3d-434f-9d42-bd6883f13e5d', 'status': 'completed', 'code': 200} Nov 08 04:12:15.783107 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-56d27745-2f58-4a6b-a186-0c18124180bf req-6780abe7-3509-4f5c-813d-94e472237514 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489430 Nov 08 04:12:15.815355 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50848) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:15.878738 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-880dacdd-8029-4729-9191-5ce5a5e0060a req-393c208e-b53a-4cb6-9343-a0e7166e18b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:15.880272 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-880dacdd-8029-4729-9191-5ce5a5e0060a req-393c208e-b53a-4cb6-9343-a0e7166e18b9 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 1096 time: 0.0514448 Nov 08 04:12:15.920952 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-493562641-network', 'tenant_id': 'eb8399a753604e5c9663ccec7bcefe8a'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:12:15.932028 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:16.010427 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-880dacdd-8029-4729-9191-5ce5a5e0060a req-3fb8c93d-b64a-459f-9c87-f5c713f51093 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:16.011906 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-880dacdd-8029-4729-9191-5ce5a5e0060a req-3fb8c93d-b64a-459f-9c87-f5c713f51093 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0962698 Nov 08 04:12:16.029912 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Made reservation on behalf of eb8399a753604e5c9663ccec7bcefe8a for: {'network': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:12:16.032340 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:16.041527 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:16.113940 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:16.178654 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:16.191218 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a2d839e-eb9d-46c5-b7a3-fbb8e5a98560 req-d1ccfcb8-d898-45a6-92a0-2f77fc0d2a3e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:16.192830 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9a2d839e-eb9d-46c5-b7a3-fbb8e5a98560 req-d1ccfcb8-d898-45a6-92a0-2f77fc0d2a3e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 943 time: 0.1113753 Nov 08 04:12:16.201039 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] vlan segment allocate from pool success with {'vlan_id': 181, 'physical_network': 'physnet1'} {{(pid=101664) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:12:16.220404 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70dc6571-d0e9-4e91-8725-d295f8997ee1,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:16.222974 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:16.223491 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.segments_db [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Added segment 524baf57-01df-4010-852f-3cb999bc7743 of type vlan for network 469f55bd-b66f-46d3-ac06-2dbcb2fd1255 Nov 08 04:12:16.228313 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-880dacdd-8029-4729-9191-5ce5a5e0060a req-11ecfc99-7b6a-44b3-8b1c-33d3d88d3262 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:16.229774 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-880dacdd-8029-4729-9191-5ce5a5e0060a req-11ecfc99-7b6a-44b3-8b1c-33d3d88d3262 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1386349 Nov 08 04:12:16.237392 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.237793 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.238332 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.238647 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.238979 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.239306 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.239632 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.239953 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.240274 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.240589 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.240904 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.241219 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:16.260206 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9a2d839e-eb9d-46c5-b7a3-fbb8e5a98560 req-1f17c5f7-0e72-4f06-b546-d8c1793d4993 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544243 Nov 08 04:12:16.290954 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:16.359974 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-fb5d5696-bc78-443e-a234-6527f91e30d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:16.361660 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-fb5d5696-bc78-443e-a234-6527f91e30d7 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 1096 time: 0.0392160 Nov 08 04:12:16.396202 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:16.397193 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:16.397779 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:16.428547 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-c2fc8149-08db-40a8-b75d-2c8bef103a4b service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=946fbfcb-ea3d-434f-9d42-bd6883f13e5d HTTP/1.1" status: 200 len: 217 time: 0.0342295 Nov 08 04:12:16.457627 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] Pushing event updated for resources: {'Network': ['ID=469f55bd-b66f-46d3-ac06-2dbcb2fd1255,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:16.468639 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 469f55bd-b66f-46d3-ac06-2dbcb2fd1255 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:12:16.496275 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-c4243b29-2c24-45ba-8691-67cdf0bded2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:16.497013 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-bbe900cb-92e8-46a4-b38c-6b0a3b304a88 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.6805527 Nov 08 04:12:16.497674 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50856) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:16.498005 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-c4243b29-2c24-45ba-8691-67cdf0bded2f service neutron] 10.222.0.16 "GET /v2.0/subnets?id=59ccbcae-2516-4cc7-9077-478845e3e1f2 HTTP/1.1" status: 200 len: 854 time: 0.0581915 Nov 08 04:12:16.502888 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Request body: {'subnet': {'network_id': '469f55bd-b66f-46d3-ac06-2dbcb2fd1255', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-493562641-subnet', 'tenant_id': 'eb8399a753604e5c9663ccec7bcefe8a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:12:16.543665 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-db35c032-816f-4482-95d2-ee93538c0116 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1516eeae-19de-448e-9ebd-952b54f99dcc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0288687 Nov 08 04:12:16.627646 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Made reservation on behalf of eb8399a753604e5c9663ccec7bcefe8a for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:12:16.636144 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:16.640829 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-ebdca61a-fdaf-4e6c-8832-2a3e1dce3270 service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0870681 Nov 08 04:12:16.764605 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffe54c2b-02f7-4970-924e-e2e6f4c793be req-9c4ac310-6d46-46b7-9718-1882593d671d service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1106994 Nov 08 04:12:16.929284 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2083e3ff-0c35-4ed5-bafa-85d67dcc69d4 req-546b54f0-6d82-4f04-9912-636ca060a2e1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:16.931347 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2083e3ff-0c35-4ed5-bafa-85d67dcc69d4 req-546b54f0-6d82-4f04-9912-636ca060a2e1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0520172 Nov 08 04:12:16.978911 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2083e3ff-0c35-4ed5-bafa-85d67dcc69d4 req-d9e563da-33f5-4f55-a1ab-7d77f8913be6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412328 Nov 08 04:12:17.085683 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:17.122267 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50874) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:17.144098 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Pushing event updated for resources: {'Subnet': ['ID=53fa0a8f-81b3-40ef-838a-ae1ebc251661,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:17.162572 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Checking segment: {'id': '524baf57-01df-4010-852f-3cb999bc7743', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 181, 'network_id': '469f55bd-b66f-46d3-ac06-2dbcb2fd1255'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:12:17.162942 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Network hostable DHCP agents. Network: 469f55bd-b66f-46d3-ac06-2dbcb2fd1255, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:12:17.235808 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Network 469f55bd-b66f-46d3-ac06-2dbcb2fd1255 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:12:17.248636 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ed94282-f37e-40f0-82c5-de0ba7690c5f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:17.327719 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ed94282-f37e-40f0-82c5-de0ba7690c5f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:17.336042 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 469f55bd-b66f-46d3-ac06-2dbcb2fd1255) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:12:17.340241 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:17.340908 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:17.345954 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c8e08a6-0909-4d17-a713-395c0ee10f01 None None] Network 469f55bd-b66f-46d3-ac06-2dbcb2fd1255 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:12:17.393370 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ed94282-f37e-40f0-82c5-de0ba7690c5f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:17.393778 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23f32cf-7490-4132-8376-8f647634ded1 req-8ae81f77-023a-4e7a-953c-b5460bed716e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:17.395288 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a23f32cf-7490-4132-8376-8f647634ded1 req-8ae81f77-023a-4e7a-953c-b5460bed716e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 943 time: 0.0606241 Nov 08 04:12:17.425651 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f02107de-2e26-4576-bc75-298ddf63b561 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.9267690 Nov 08 04:12:17.441700 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-7ed94282-f37e-40f0-82c5-de0ba7690c5f admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=dfe3a753f8af4ad49e3c7d1149d2d8e3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3169413 Nov 08 04:12:17.447279 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50882) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:17.465540 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a23f32cf-7490-4132-8376-8f647634ded1 req-87d3bb56-f169-4817-9a9f-f843f69c253f tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630572 Nov 08 04:12:17.468633 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ed94282-f37e-40f0-82c5-de0ba7690c5f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c7acf27-f1b7-492d-881c-90d0deb9d90b,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:17.504451 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cecef341-721e-448d-a688-dbb9d187c617 None None] Network 469f55bd-b66f-46d3-ac06-2dbcb2fd1255 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:12:17.526413 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ad1cc699-b411-4a00-9fc9-c68cbd47dcaf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:17.548913 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ad1cc699-b411-4a00-9fc9-c68cbd47dcaf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:17.658726 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:17.703910 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ad1cc699-b411-4a00-9fc9-c68cbd47dcaf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:17.706617 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ad1cc699-b411-4a00-9fc9-c68cbd47dcaf admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:17.707790 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-ad1cc699-b411-4a00-9fc9-c68cbd47dcaf admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/5c7acf27-f1b7-492d-881c-90d0deb9d90b HTTP/1.1" status: 204 len: 168 time: 0.2595937 Nov 08 04:12:17.716739 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad1cc699-b411-4a00-9fc9-c68cbd47dcaf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c7acf27-f1b7-492d-881c-90d0deb9d90b,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:18.133978 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-748ba4e0-e8cb-4602-af4b-c36219279993 req-6664cdfe-f1a2-4399-858d-0401af207a14 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:18.136484 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-748ba4e0-e8cb-4602-af4b-c36219279993 req-6664cdfe-f1a2-4399-858d-0401af207a14 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0582876 Nov 08 04:12:18.201127 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-748ba4e0-e8cb-4602-af4b-c36219279993 req-fea20a2b-4d8d-40f8-a20b-a37d975ef912 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581005 Nov 08 04:12:18.349478 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 50918) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:18.355384 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-2137612735-network', 'tenant_id': 'a1695abd1409467a958656620ff06192'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:12:18.378892 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:18.470816 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Made reservation on behalf of a1695abd1409467a958656620ff06192 for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:12:18.473494 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:18.484658 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:18.568703 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:18.614159 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47e9c4e9-cf55-4872-b772-8b1142d02c72 req-2ddba22a-89f6-4428-b2b9-59cf59484953 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:18.615639 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-47e9c4e9-cf55-4872-b772-8b1142d02c72 req-2ddba22a-89f6-4428-b2b9-59cf59484953 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 943 time: 0.0629468 Nov 08 04:12:18.665965 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-47e9c4e9-cf55-4872-b772-8b1142d02c72 req-b810612a-f240-4ae3-8db6-e1678ba77a0d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436680 Nov 08 04:12:18.668563 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:18.691589 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] vlan segment allocate from pool success with {'vlan_id': 185, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:12:18.705665 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3d24fb3-3ca4-437f-a2db-0ec472daf62b,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:18.711312 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:18.711646 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Added segment 5635675a-dbd6-47aa-9257-bbae99978102 of type vlan for network 6dec1992-8266-427e-96b0-30180e9254bb Nov 08 04:12:18.776252 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:18.816698 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4b3254-3f90-4c56-9999-0cfac0771740 req-b24ac714-3fe5-4470-bad4-2f128655bc58 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:18.818166 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de4b3254-3f90-4c56-9999-0cfac0771740 req-b24ac714-3fe5-4470-bad4-2f128655bc58 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 945 time: 0.0958493 Nov 08 04:12:18.873720 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de4b3254-3f90-4c56-9999-0cfac0771740 req-bd64635a-40dd-441c-88f3-e62cd925fdc5 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484054 Nov 08 04:12:18.878590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:18.879559 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:18.880272 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:18.937571 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] Pushing event updated for resources: {'Network': ['ID=6dec1992-8266-427e-96b0-30180e9254bb,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:18.947939 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 6dec1992-8266-427e-96b0-30180e9254bb details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:12:18.981747 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-d939bba6-ad61-498b-b706-dbbb5d458fea admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6309335 Nov 08 04:12:18.984509 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 50936) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:18.993672 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Request body: {'subnet': {'network_id': '6dec1992-8266-427e-96b0-30180e9254bb', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-2137612735-subnet', 'tenant_id': 'a1695abd1409467a958656620ff06192', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:12:19.081717 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Made reservation on behalf of a1695abd1409467a958656620ff06192 for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:12:19.084301 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Publish callbacks [] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:19.310771 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:19.335090 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-530f63b6-3ac9-472d-b00d-76a026c7324f req-d0378ac6-50c1-4deb-97e9-e2854bc5e97b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:19.338975 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-530f63b6-3ac9-472d-b00d-76a026c7324f req-d0378ac6-50c1-4deb-97e9-e2854bc5e97b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0577242 Nov 08 04:12:19.379568 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Pushing event updated for resources: {'Subnet': ['ID=d240d600-d50d-4057-abca-52686b1ea617,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:19.389779 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Checking segment: {'id': '5635675a-dbd6-47aa-9257-bbae99978102', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 185, 'network_id': '6dec1992-8266-427e-96b0-30180e9254bb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:12:19.390141 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Network hostable DHCP agents. Network: 6dec1992-8266-427e-96b0-30180e9254bb, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:12:19.390257 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-530f63b6-3ac9-472d-b00d-76a026c7324f req-30ada0b4-7a4b-45da-9c92-042a19063372 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468271 Nov 08 04:12:19.479660 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Network 6dec1992-8266-427e-96b0-30180e9254bb is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:12:19.564404 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 6dec1992-8266-427e-96b0-30180e9254bb) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:12:19.569072 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:19.570601 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:19.574867 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b6d24d1-e033-49e1-ae22-d0bbbad5b965 None None] Network 6dec1992-8266-427e-96b0-30180e9254bb requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:12:19.653425 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a38af20b-73b7-4322-b07e-4e9fd2ed837b admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6677268 Nov 08 04:12:19.710080 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c5c3e00-4582-4f16-bd5f-09a5b88c84fd None None] Network 6dec1992-8266-427e-96b0-30180e9254bb requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:12:19.804179 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150d33eb-aa5a-4dbc-bcea-1fd2c06bc7a1 req-27196037-17ea-4dc5-a9e5-ee5bf907a2c2 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:19.811989 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-150d33eb-aa5a-4dbc-bcea-1fd2c06bc7a1 req-27196037-17ea-4dc5-a9e5-ee5bf907a2c2 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 943 time: 0.0605857 Nov 08 04:12:19.855958 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-150d33eb-aa5a-4dbc-bcea-1fd2c06bc7a1 req-0229e80c-3c6c-4348-9144-aa89bde59e4d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432973 Nov 08 04:12:20.001489 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f19271a-6775-4f65-aa6d-9bb49079353a req-f4312d29-8bd7-43ad-ba97-c76047d0eda6 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:20.003061 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f19271a-6775-4f65-aa6d-9bb49079353a req-f4312d29-8bd7-43ad-ba97-c76047d0eda6 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 945 time: 0.0626783 Nov 08 04:12:20.061849 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f19271a-6775-4f65-aa6d-9bb49079353a req-f7c378c0-88b7-4deb-b7a3-35f52b4a8d8d tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520504 Nov 08 04:12:20.526776 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb83a14-e1f5-4734-a08a-12d926f58163 req-8360028d-69b7-436c-a5d9-379516ab1108 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:20.527198 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6fb83a14-e1f5-4734-a08a-12d926f58163 req-8360028d-69b7-436c-a5d9-379516ab1108 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0566120 Nov 08 04:12:20.578244 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6fb83a14-e1f5-4734-a08a-12d926f58163 req-ea043b81-70bb-4199-b23f-eee3718f6498 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427775 Nov 08 04:12:20.857683 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 946fbfcb-ea3d-434f-9d42-bd6883f13e5d details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:12:20.977097 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d51787c-0567-4545-88c6-eca4a9812c0b req-4fb56eba-f92c-456d-a660-477ec0d7b7cd tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:20.978652 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4d51787c-0567-4545-88c6-eca4a9812c0b req-4fb56eba-f92c-456d-a660-477ec0d7b7cd tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 943 time: 0.0499039 Nov 08 04:12:21.033873 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4d51787c-0567-4545-88c6-eca4a9812c0b req-db1546f9-43c9-4932-901f-c3688d0ffe5a tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472648 Nov 08 04:12:21.069153 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:12:21.080648 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '946fbfcb-ea3d-434f-9d42-bd6883f13e5d', 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc', 'port_id': '946fbfcb-ea3d-434f-9d42-bd6883f13e5d', 'mac_address': 'fa:16:3e:a5:25:cd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59ccbcae-2516-4cc7-9077-478845e3e1f2', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:12:21.128980 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:21.142881 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 946fbfcb-ea3d-434f-9d42-bd6883f13e5d {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:12:21.162148 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:12:21.190735 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f753124e-ee67-4688-a663-181027287499 req-4f69c3e7-e0f0-492b-82fd-8ea33693e4f4 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:21.192188 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f753124e-ee67-4688-a663-181027287499 req-4f69c3e7-e0f0-492b-82fd-8ea33693e4f4 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 945 time: 0.0493836 Nov 08 04:12:21.238109 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f753124e-ee67-4688-a663-181027287499 req-fd2fa6b8-ef14-473c-8f85-d999ff0300de tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395112 Nov 08 04:12:21.247204 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:21.294406 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:21.301323 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.301693 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.303791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.303791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.303791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.303791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.303791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.303791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.304359 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.304359 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.304613 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.304930 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:12:21.715857 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25788f63-b9e3-4f38-8474-84a553f4e7af req-530f77fd-7496-45e8-a37b-1f58dddad7b3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:21.717341 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25788f63-b9e3-4f38-8474-84a553f4e7af req-530f77fd-7496-45e8-a37b-1f58dddad7b3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0492241 Nov 08 04:12:21.764961 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25788f63-b9e3-4f38-8474-84a553f4e7af req-171c6294-f24c-41ca-892c-9b1e486e7756 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415545 Nov 08 04:12:21.933720 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['946fbfcb-ea3d-434f-9d42-bd6883f13e5d'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:12:22.176060 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8cfa0e-3bca-4d18-a337-fd05d291a252 req-8b3562fa-d8fb-4efd-a43e-92aa3fd74a57 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:22.177581 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f8cfa0e-3bca-4d18-a337-fd05d291a252 req-8b3562fa-d8fb-4efd-a43e-92aa3fd74a57 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 944 time: 0.0676198 Nov 08 04:12:22.230550 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f8cfa0e-3bca-4d18-a337-fd05d291a252 req-d37b5728-aee0-4116-9947-8f073303390b tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470049 Nov 08 04:12:22.354427 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b68c1862-b89c-4ebc-bc6d-dede6f347ff0 req-9855fd4a-194a-41f9-a3ad-0f5674885242 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:22.355894 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b68c1862-b89c-4ebc-bc6d-dede6f347ff0 req-9855fd4a-194a-41f9-a3ad-0f5674885242 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 945 time: 0.0486653 Nov 08 04:12:22.401076 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b68c1862-b89c-4ebc-bc6d-dede6f347ff0 req-a027e263-0404-4c59-9840-9b80ecc4fcf3 tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/security-groups?id=36102ae7-0ddc-41f4-9315-3e2df4d2d253&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391166 Nov 08 04:12:22.458545 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-e72611ac-5259-4772-89a8-19f4412597fa tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:22.459965 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-e72611ac-5259-4772-89a8-19f4412597fa tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.16 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 945 time: 0.0477879 Nov 08 04:12:22.522107 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-a8e87609-e487-4e04-ade2-feb54c82c048 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0472157 Nov 08 04:12:22.633988 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-8f75737c-b202-481d-9519-527f89f36a5e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Deleting port c8b44127-b903-47ea-98e3-772137eab0f6 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:12:22.634468 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-8f75737c-b202-481d-9519-527f89f36a5e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:22.662548 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-919db5cb-d941-475a-9d4d-1c878d54e63d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:22.663953 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-919db5cb-d941-475a-9d4d-1c878d54e63d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 1099 time: 0.0408394 Nov 08 04:12:22.728543 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-8f75737c-b202-481d-9519-527f89f36a5e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] For port c8b44127-b903-47ea-98e3-772137eab0f6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=c8b44127-b903-47ea-98e3-772137eab0f6,segment=NetworkSegment(40c10b14-9bad-4182-9d99-8cce48b6c4f8),segment_id=40c10b14-9bad-4182-9d99-8cce48b6c4f8)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:12:22.728897 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-8f75737c-b202-481d-9519-527f89f36a5e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:22.743879 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-8f75737c-b202-481d-9519-527f89f36a5e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Calling delete_port for c8b44127-b903-47ea-98e3-772137eab0f6 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:12:22.776657 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-58dc88d2-6eae-4263-a9c2-52bcb3200278 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:22.779252 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-58dc88d2-6eae-4263-a9c2-52bcb3200278 service neutron] 10.222.0.16 "GET /v2.0/networks?id=1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 200 len: 915 time: 0.0920773 Nov 08 04:12:22.826907 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-f62fbdf1-3f32-4920-8f47-e6453a28f7e2 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f790fbae-e681-4e01-b1a4-67513d491300 HTTP/1.1" status: 200 len: 217 time: 0.0387814 Nov 08 04:12:22.886894 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-e4dc3dbd-0a1e-45ac-ae84-3b422b7bb168 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:22.889013 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-e4dc3dbd-0a1e-45ac-ae84-3b422b7bb168 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=59ccbcae-2516-4cc7-9077-478845e3e1f2 HTTP/1.1" status: 200 len: 854 time: 0.0479548 Nov 08 04:12:22.930998 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-d34a7f94-afc0-4e82-b6a1-3f7bedca7064 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1516eeae-19de-448e-9ebd-952b54f99dcc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0324888 Nov 08 04:12:23.037941 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-55d0c0ce-a4ac-49b1-a433-ebf86ac67e72 service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0987303 Nov 08 04:12:23.075216 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8964efe-1314-4e74-879c-c1e770efbe79 req-03a3d4ab-88a8-40fb-8278-8d9668bbbf3f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:23.077001 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b8964efe-1314-4e74-879c-c1e770efbe79 req-03a3d4ab-88a8-40fb-8278-8d9668bbbf3f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0638816 Nov 08 04:12:23.144065 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-782f14ad-1deb-4dd8-b5aa-a71166fe60f3 req-404172f0-8fbb-4bc2-9f02-b2d2a3e1ce12 service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0926178 Nov 08 04:12:23.159833 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b8964efe-1314-4e74-879c-c1e770efbe79 req-8bb12fad-d0a5-4d65-8f61-2d555edfa56d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705557 Nov 08 04:12:23.276371 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-8f75737c-b202-481d-9519-527f89f36a5e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:23.310646 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f75737c-b202-481d-9519-527f89f36a5e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Pushing event deleted for resources: {'Port': ['ID=c8b44127-b903-47ea-98e3-772137eab0f6,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:23.341583 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['c8b44127-b903-47ea-98e3-772137eab0f6'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:12:23.411473 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-8f75737c-b202-481d-9519-527f89f36a5e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] No DVR routers for this DVR port c8b44127-b903-47ea-98e3-772137eab0f6 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:12:23.415263 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-8f75737c-b202-481d-9519-527f89f36a5e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:23.418731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-215f1d09-f8e5-4950-823b-356f4e9cb0bf req-8f75737c-b202-481d-9519-527f89f36a5e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.16 "DELETE /v2.0/ports/c8b44127-b903-47ea-98e3-772137eab0f6 HTTP/1.1" status: 204 len: 173 time: 0.9433992 Nov 08 04:12:23.420875 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f882d66b-3620-4d68-9751-4f2683e2d565', 'name': 'network-vif-deleted', 'tag': 'c8b44127-b903-47ea-98e3-772137eab0f6'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:12:23.425007 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1dc91a5b-db99-4b6e-b382-6606919d4105" -d '{"events": [{"server_uuid": "f882d66b-3620-4d68-9751-4f2683e2d565", "name": "network-vif-deleted", "tag": "c8b44127-b903-47ea-98e3-772137eab0f6"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:12:23.440278 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba1f668-e26a-4d8a-bef1-c7a009974f12 req-68da9b2a-8894-4484-98ba-44b8f3978376 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:23.441749 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cba1f668-e26a-4d8a-bef1-c7a009974f12 req-68da9b2a-8894-4484-98ba-44b8f3978376 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 944 time: 0.1289430 Nov 08 04:12:23.512206 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34e49a7f-8a4b-4b5a-9c98-8897c2088662 req-08cdcbc4-f9f8-499d-8281-e778a4390dab tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 210 time: 0.0368071 Nov 08 04:12:23.524227 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cba1f668-e26a-4d8a-bef1-c7a009974f12 req-b35e1ff7-56fe-4c9f-9312-ced8ecbd4646 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706561 Nov 08 04:12:23.557170 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:12:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00988b6c-7fd3-452d-b432-15fd46c4ac30 x-openstack-request-id: req-00988b6c-7fd3-452d-b432-15fd46c4ac30 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:12:23.557605 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f882d66b-3620-4d68-9751-4f2683e2d565", "name": "network-vif-deleted", "tag": "c8b44127-b903-47ea-98e3-772137eab0f6", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:12:23.557812 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-00988b6c-7fd3-452d-b432-15fd46c4ac30 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:12:23.558098 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f882d66b-3620-4d68-9751-4f2683e2d565', 'name': 'network-vif-deleted', 'tag': 'c8b44127-b903-47ea-98e3-772137eab0f6', 'status': 'completed', 'code': 200} Nov 08 04:12:24.130325 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:24.289421 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1577949b-66ea-43f4-af5e-5be52dace3ee req-24011494-29a6-450b-8271-370ef514d83a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:24.290980 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1577949b-66ea-43f4-af5e-5be52dace3ee req-24011494-29a6-450b-8271-370ef514d83a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0515561 Nov 08 04:12:24.343172 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1577949b-66ea-43f4-af5e-5be52dace3ee req-a6798aee-d80e-407d-8056-973b36b64bba tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416241 Nov 08 04:12:24.635088 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8f9ef165-f04f-4147-b41d-912ac0ccebef req-e9119197-daab-4636-8593-88de4a4eff8e tempest-DeleteServersTestJSON-442062651 tempest-DeleteServersTestJSON-442062651-project] 10.222.0.21 "GET /v2.0/ports?device_id=f882d66b-3620-4d68-9751-4f2683e2d565 HTTP/1.1" status: 200 len: 210 time: 0.0340998 Nov 08 04:12:24.672120 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ff49ae3-39b7-4cfe-b570-b0f220b0d7e8 req-f8d48a5f-7e75-489f-929f-108d057e8866 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:24.673727 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6ff49ae3-39b7-4cfe-b570-b0f220b0d7e8 req-f8d48a5f-7e75-489f-929f-108d057e8866 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 944 time: 0.0717182 Nov 08 04:12:24.720427 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6ff49ae3-39b7-4cfe-b570-b0f220b0d7e8 req-ec62da3b-c0ef-4f40-ad4b-bfbaf8871b15 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402868 Nov 08 04:12:24.893555 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 946fbfcb-ea3d-434f-9d42-bd6883f13e5d up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:12:24.999308 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:12:25.006632 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:12:25.006632 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:25.086521 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:25.109578 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '42fd1d8f-82f7-4a08-9078-ff02a30df4e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '946fbfcb-ea3d-434f-9d42-bd6883f13e5d'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:12:25.112132 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5af071d8-0ec4-4884-8e43-763e945de7f9" -d '{"events": [{"server_uuid": "42fd1d8f-82f7-4a08-9078-ff02a30df4e6", "name": "network-vif-plugged", "status": "completed", "tag": "946fbfcb-ea3d-434f-9d42-bd6883f13e5d"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:12:25.125175 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:12:25.153714 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:12:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed4d0716-62d1-450e-993e-ccca3c99dc19 x-openstack-request-id: req-ed4d0716-62d1-450e-993e-ccca3c99dc19 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:12:25.154026 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "42fd1d8f-82f7-4a08-9078-ff02a30df4e6", "name": "network-vif-plugged", "status": "completed", "tag": "946fbfcb-ea3d-434f-9d42-bd6883f13e5d", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:12:25.154283 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-ed4d0716-62d1-450e-993e-ccca3c99dc19 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:12:25.154713 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '42fd1d8f-82f7-4a08-9078-ff02a30df4e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '946fbfcb-ea3d-434f-9d42-bd6883f13e5d', 'code': 200} Nov 08 04:12:25.208324 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:25.263912 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:25.457550 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbe5dcdf-2646-4626-820c-5a9fb98e978c req-ce49e839-3ba0-4768-8eac-4de08a4ba6dd tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:25.458919 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbe5dcdf-2646-4626-820c-5a9fb98e978c req-ce49e839-3ba0-4768-8eac-4de08a4ba6dd tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0473096 Nov 08 04:12:25.509004 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbe5dcdf-2646-4626-820c-5a9fb98e978c req-ca7cd0e6-df35-4a82-bce7-4fb8cbe0e128 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434246 Nov 08 04:12:25.602073 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642c6190-d4f1-44ee-87b0-37d27f30e964 req-87b2bb44-4571-4296-8508-64ff15796031 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:25.604000 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-642c6190-d4f1-44ee-87b0-37d27f30e964 req-87b2bb44-4571-4296-8508-64ff15796031 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 1098 time: 0.0412757 Nov 08 04:12:25.683360 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-642c6190-d4f1-44ee-87b0-37d27f30e964 req-103fd7bd-7a16-4966-a62d-da3ea9da91ff service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428708 Nov 08 04:12:25.838521 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-075952f1-b7ed-4fb7-92a6-7317c14f3c44 req-e482625d-7d69-4924-b863-b755701f3696 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:25.840447 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-075952f1-b7ed-4fb7-92a6-7317c14f3c44 req-e482625d-7d69-4924-b863-b755701f3696 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 945 time: 0.0492282 Nov 08 04:12:25.889551 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-075952f1-b7ed-4fb7-92a6-7317c14f3c44 req-8fde089a-bdc9-4569-9056-467f446fef6c tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427911 Nov 08 04:12:26.643754 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd75bcf3-8727-41d2-a62c-803e5693a895 req-3ece49e0-9f64-4b4b-98bd-ef4607d33e02 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:26.645330 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fd75bcf3-8727-41d2-a62c-803e5693a895 req-3ece49e0-9f64-4b4b-98bd-ef4607d33e02 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0678070 Nov 08 04:12:26.694157 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fd75bcf3-8727-41d2-a62c-803e5693a895 req-d8b00ee7-54ed-4cc3-9e49-5b3f41f1c4c4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419698 Nov 08 04:12:26.893565 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device c8b44127-b903-47ea-98e3-772137eab0f6 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:12:26.914835 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: c8b44127-b903-47ea-98e3-772137eab0f6 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:12:26.915177 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device c8b44127-b903-47ea-98e3-772137eab0f6 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:12:27.012665 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8afe6535-a544-40c8-9ac7-2d1837d3f216 req-bc842ae2-cbc1-4849-ae4e-72f31d3d89d3 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:27.014116 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8afe6535-a544-40c8-9ac7-2d1837d3f216 req-bc842ae2-cbc1-4849-ae4e-72f31d3d89d3 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 945 time: 0.0535145 Nov 08 04:12:27.062714 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8afe6535-a544-40c8-9ac7-2d1837d3f216 req-2716027d-08a5-4229-b3f7-7a534d80d8c8 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422444 Nov 08 04:12:27.195911 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51166) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:27.239997 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_v2 [None req-616bdbbe-3e98-4603-b206-46ee24508192 admin admin] Deleting subnet e73cdb7b-96cb-4d2a-bf8a-e10140c5dc14 {{(pid=101665) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:12:27.243261 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-616bdbbe-3e98-4603-b206-46ee24508192 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:27.277440 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-616bdbbe-3e98-4603-b206-46ee24508192 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:27.286961 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-616bdbbe-3e98-4603-b206-46ee24508192 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:27.422173 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-616bdbbe-3e98-4603-b206-46ee24508192 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:27.453712 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-616bdbbe-3e98-4603-b206-46ee24508192 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e73cdb7b-96cb-4d2a-bf8a-e10140c5dc14,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:27.454896 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-616bdbbe-3e98-4603-b206-46ee24508192 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:27.458097 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-616bdbbe-3e98-4603-b206-46ee24508192 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/e73cdb7b-96cb-4d2a-bf8a-e10140c5dc14 HTTP/1.1" status: 204 len: 168 time: 0.2611656 Nov 08 04:12:27.460637 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51172) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:27.531194 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:27.617945 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:27.638655 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > segment before_delete 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.638957 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.639726 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.640068 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > port after_create 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.640387 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > port after_delete 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.640716 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > port after_update 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.641030 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > segment after_delete 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.641361 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.641673 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.641992 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > subnet after_update 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.805689 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.806377 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.806377 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > subnet before_create 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.806714 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Subscribe: > subnet before_update 55550000 {{(pid=101665) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:27.807098 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['73a3dfba-be87-4070-93d2-b14149196c8c']}} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:27.845461 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '40c10b14-9bad-4182-9d99-8cce48b6c4f8') {'for_net_delete': True} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:27.845753 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '40c10b14-9bad-4182-9d99-8cce48b6c4f8') {} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:27.868970 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4636247'] for segment, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:27.894696 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:27.907114 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e73d6f-959a-4cf9-b4d6-6c9f7cca40f3 req-f1b02680-55f0-4f7a-9cf4-bd4691e3df38 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:27.908706 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-72e73d6f-959a-4cf9-b4d6-6c9f7cca40f3 req-f1b02680-55f0-4f7a-9cf4-bd4691e3df38 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0966790 Nov 08 04:12:27.912809 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Releasing vlan 152 on physical network physnet1 to pool {{(pid=101665) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:12:27.913204 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6273258'] for segment, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: from cryptography.utils import int_from_bytes Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: from cryptography.utils import int_from_bytes Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: Traceback (most recent call last): Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: timer() Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: cb(*args, **kw) Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: return func(*args, **kwargs) Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: self._notify() Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: self.callback(batched_events) Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: event.method(event) Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: return f(self, *a, **k) Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._get(url).json() Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: return self.request(url, 'GET', **kwargs) Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:12:27.936736 dv-cinder-783643-4-iscsi neutron-server[101665]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:12:28.023589 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-72e73d6f-959a-4cf9-b4d6-6c9f7cca40f3 req-cecbdeb8-8fd8-4438-8e7a-59b7b0127ac4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0858567 Nov 08 04:12:28.078881 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:28.086345 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:28.092296 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] 10.222.0.21 "DELETE /v2.0/networks/73a3dfba-be87-4070-93d2-b14149196c8c HTTP/1.1" status: 204 len: 168 time: 0.6283557 Nov 08 04:12:28.100256 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa4b0295-1e65-4c1b-bea6-2d9022e5df7a admin admin] Pushing event deleted for resources: {'Network': ['ID=73a3dfba-be87-4070-93d2-b14149196c8c,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:28.205689 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6819d11-acdc-4cd1-b22e-fb8a415318a1 req-09428182-44a0-44da-8e39-92eb2c81e0a9 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:28.207191 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6819d11-acdc-4cd1-b22e-fb8a415318a1 req-09428182-44a0-44da-8e39-92eb2c81e0a9 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 945 time: 0.0540652 Nov 08 04:12:28.255943 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6819d11-acdc-4cd1-b22e-fb8a415318a1 req-c7db093d-c024-4e7f-9bd9-9623565e534b tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420392 Nov 08 04:12:28.540580 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51206) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:28.582890 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-2291956e-5a3b-4fed-bbef-6bbeec2a8617 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=10aa52c671b04a70bee6132d644fcea6&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0409541 Nov 08 04:12:28.586501 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51208) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:28.635809 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c00c2aa-dcb2-456a-b8e0-485fb7f00f78 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:28.656479 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c00c2aa-dcb2-456a-b8e0-485fb7f00f78 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:28.798819 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c00c2aa-dcb2-456a-b8e0-485fb7f00f78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:28.801651 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c00c2aa-dcb2-456a-b8e0-485fb7f00f78 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:28.802699 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-7c00c2aa-dcb2-456a-b8e0-485fb7f00f78 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/36102ae7-0ddc-41f4-9315-3e2df4d2d253 HTTP/1.1" status: 204 len: 168 time: 0.2146187 Nov 08 04:12:28.810438 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c00c2aa-dcb2-456a-b8e0-485fb7f00f78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36102ae7-0ddc-41f4-9315-3e2df4d2d253,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:29.139934 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e05fed4-7e95-47f4-b942-8f8fbdb53d92 req-0dfecb14-f04b-4b11-a4b3-cad4b84d420e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:29.140738 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8e05fed4-7e95-47f4-b942-8f8fbdb53d92 req-0dfecb14-f04b-4b11-a4b3-cad4b84d420e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0510888 Nov 08 04:12:29.191608 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8e05fed4-7e95-47f4-b942-8f8fbdb53d92 req-1d83b20f-6162-41e0-adff-106962099ff5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448632 Nov 08 04:12:30.311336 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940f36e0-9ed9-4bb9-87ed-7156c2994fb5 req-66188455-7ce1-4aee-8d75-eeb2792bd6ed tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:30.312744 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-940f36e0-9ed9-4bb9-87ed-7156c2994fb5 req-66188455-7ce1-4aee-8d75-eeb2792bd6ed tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0541322 Nov 08 04:12:30.361184 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-940f36e0-9ed9-4bb9-87ed-7156c2994fb5 req-dd7d2a71-2566-4ed7-ab75-e4dc840f41eb tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423350 Nov 08 04:12:31.412487 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51320) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:31.491389 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c52f46e2-3031-4ba0-921a-95e28d917ec1 req-ef412da2-d6aa-404b-914c-24e10b9365ae tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:31.493074 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c52f46e2-3031-4ba0-921a-95e28d917ec1 req-ef412da2-d6aa-404b-914c-24e10b9365ae tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0494618 Nov 08 04:12:31.552056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c52f46e2-3031-4ba0-921a-95e28d917ec1 req-994d1606-164a-46f9-ac62-a1e8ad61513d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486305 Nov 08 04:12:31.588461 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-8dcf547a-5edb-4720-ae06-eea242525d18 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:31.667675 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-8dcf547a-5edb-4720-ae06-eea242525d18 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:31.737983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-8dcf547a-5edb-4720-ae06-eea242525d18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:31.778345 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-8dcf547a-5edb-4720-ae06-eea242525d18 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=06968bdb0f744e27b800701c058d1ee2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3647671 Nov 08 04:12:31.779204 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dcf547a-5edb-4720-ae06-eea242525d18 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74288557-ff09-47f6-a3ec-a6793ed6cd01,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:31.781015 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51330) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:31.833691 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-26fb1165-75e2-4524-b003-5fa6314472fd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:31.855026 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-26fb1165-75e2-4524-b003-5fa6314472fd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:31.972380 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-26fb1165-75e2-4524-b003-5fa6314472fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:31.974973 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-26fb1165-75e2-4524-b003-5fa6314472fd admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:31.976126 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-26fb1165-75e2-4524-b003-5fa6314472fd admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/74288557-ff09-47f6-a3ec-a6793ed6cd01 HTTP/1.1" status: 204 len: 168 time: 0.1941328 Nov 08 04:12:31.983731 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26fb1165-75e2-4524-b003-5fa6314472fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74288557-ff09-47f6-a3ec-a6793ed6cd01,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:32.556236 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51342) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:32.571257 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f21ce235-9330-4b4d-9278-114fb2468583 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:32.668044 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f21ce235-9330-4b4d-9278-114fb2468583 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:32.705520 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb0f178e-0802-4b43-b764-652af208cd65 req-cb1ada87-8e63-4a08-a369-6970bef5bbb1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:32.707070 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb0f178e-0802-4b43-b764-652af208cd65 req-cb1ada87-8e63-4a08-a369-6970bef5bbb1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0490222 Nov 08 04:12:32.755513 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f21ce235-9330-4b4d-9278-114fb2468583 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:32.762151 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb0f178e-0802-4b43-b764-652af208cd65 req-c5824855-9551-46b3-91a8-c2f9909d3b49 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485969 Nov 08 04:12:32.793943 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f21ce235-9330-4b4d-9278-114fb2468583 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=f2e843c76c98411fbd332d8f5855bea5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2366047 Nov 08 04:12:32.796094 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f21ce235-9330-4b4d-9278-114fb2468583 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e0f31ba-f4ee-4688-986e-68ffe079d0f3,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:32.796885 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51352) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:32.845672 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b7dc2b83-4531-4145-9695-196d31c13705 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:32.867365 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b7dc2b83-4531-4145-9695-196d31c13705 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:32.989642 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b7dc2b83-4531-4145-9695-196d31c13705 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:32.992246 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b7dc2b83-4531-4145-9695-196d31c13705 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:32.993389 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b7dc2b83-4531-4145-9695-196d31c13705 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/0e0f31ba-f4ee-4688-986e-68ffe079d0f3 HTTP/1.1" status: 204 len: 168 time: 0.1955237 Nov 08 04:12:33.002341 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7dc2b83-4531-4145-9695-196d31c13705 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e0f31ba-f4ee-4688-986e-68ffe079d0f3,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:33.699474 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-19aea738-2164-4d52-a1b0-0a804796c479 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:33.700954 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-19aea738-2164-4d52-a1b0-0a804796c479 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/networks?id=1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 200 len: 814 time: 0.1041126 Nov 08 04:12:33.715834 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-05b03b29-e980-41be-81c8-7c8d1cd4575d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/quotas/f3ecedce4bce4764a6bd2e0cc60c4955 HTTP/1.1" status: 200 len: 375 time: 0.0091140 Nov 08 04:12:33.766235 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-ef5600a3-05c7-4ffe-ae21-7f74f0951bd9 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0450222 Nov 08 04:12:33.899521 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-330123ee-f97c-49c4-8d6f-d55e7dc283f0 service neutron] 10.222.0.21 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1228874 Nov 08 04:12:33.907918 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc878e1-d501-4755-b081-996d3dd9a29d req-9d80eec5-030b-49a5-a83d-bf6fa5a3ce21 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:33.909324 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6dc878e1-d501-4755-b081-996d3dd9a29d req-9d80eec5-030b-49a5-a83d-bf6fa5a3ce21 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0709236 Nov 08 04:12:34.012601 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6dc878e1-d501-4755-b081-996d3dd9a29d req-078f8c3f-70a8-49ee-97ee-77902dcffe46 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0941510 Nov 08 04:12:34.031585 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-1600f7da-e186-4eb8-a3ad-13634ca7d17e service neutron] 10.222.0.21 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1213381 Nov 08 04:12:34.263325 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a07ebcfc-59b1-4ec2-8d28-39d5ac826cc4 req-6147dc4b-8028-4dd8-ab6a-2441333fd0ab tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 210 time: 0.0250237 Nov 08 04:12:35.143306 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d8dec5d-b535-471f-a6a7-e97cd8e6f616 req-75111eeb-f93d-4b20-afac-70b5daf47463 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:35.144793 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5d8dec5d-b535-471f-a6a7-e97cd8e6f616 req-75111eeb-f93d-4b20-afac-70b5daf47463 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0534630 Nov 08 04:12:35.193198 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5d8dec5d-b535-471f-a6a7-e97cd8e6f616 req-e59fc71a-5e2f-43aa-af26-f2f1047d5f2e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424700 Nov 08 04:12:35.361945 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6036a5b6-2e95-4c25-9974-fdc7e7029232 req-e4bcc53d-524e-440d-b016-1f07ad08822b tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 210 time: 0.0255620 Nov 08 04:12:35.412768 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51466) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:35.515849 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f88960f1-355f-4293-b073-85630f16c73b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:35.590152 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f88960f1-355f-4293-b073-85630f16c73b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:35.652582 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f88960f1-355f-4293-b073-85630f16c73b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:35.689801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f88960f1-355f-4293-b073-85630f16c73b admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=32bf1a3819304af3a6cb8512024adccb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2759829 Nov 08 04:12:35.690893 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f88960f1-355f-4293-b073-85630f16c73b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c8773c05-5e83-4133-9118-2f914803992a,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:35.692629 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51472) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:35.742975 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a354dd33-7ecc-4f5c-92cf-d834f8977217 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:35.764765 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a354dd33-7ecc-4f5c-92cf-d834f8977217 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:35.875300 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a354dd33-7ecc-4f5c-92cf-d834f8977217 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:35.877922 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a354dd33-7ecc-4f5c-92cf-d834f8977217 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:35.879179 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a354dd33-7ecc-4f5c-92cf-d834f8977217 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/c8773c05-5e83-4133-9118-2f914803992a HTTP/1.1" status: 204 len: 168 time: 0.1850431 Nov 08 04:12:35.886929 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a354dd33-7ecc-4f5c-92cf-d834f8977217 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8773c05-5e83-4133-9118-2f914803992a,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:35.968753 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:12:36.315855 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cbe1533-c49c-4e09-88b5-a5c44cf99244 req-e7eb4751-ff71-45a4-87cf-80aa5785a354 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:36.317339 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3cbe1533-c49c-4e09-88b5-a5c44cf99244 req-e7eb4751-ff71-45a4-87cf-80aa5785a354 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0537632 Nov 08 04:12:36.377866 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3cbe1533-c49c-4e09-88b5-a5c44cf99244 req-29ac2bb9-b761-4c91-9a2b-c07cd77bd595 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538166 Nov 08 04:12:36.404372 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51498) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:36.453864 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_v2 [None req-5d7939b4-2de2-4c2e-8ae7-659b508deeeb admin admin] Deleting subnet 53fa0a8f-81b3-40ef-838a-ae1ebc251661 {{(pid=101664) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:12:36.457339 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5d7939b4-2de2-4c2e-8ae7-659b508deeeb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:36.465472 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b05fedf5-080a-4798-8e6c-a3ea018c9a7e req-123f4d6c-e5c2-44cc-a3df-a7eaae3062bd tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 210 time: 0.0275350 Nov 08 04:12:36.501177 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51500) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:36.501531 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5d7939b4-2de2-4c2e-8ae7-659b508deeeb admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:36.514413 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5d7939b4-2de2-4c2e-8ae7-659b508deeeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:36.516249 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b285b16c-2707-457f-a1eb-017a0e6ca4a0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:36.641644 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5d7939b4-2de2-4c2e-8ae7-659b508deeeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:36.669431 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5d7939b4-2de2-4c2e-8ae7-659b508deeeb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:36.672768 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-5d7939b4-2de2-4c2e-8ae7-659b508deeeb admin admin] 10.222.0.21 "DELETE /v2.0/subnets/53fa0a8f-81b3-40ef-838a-ae1ebc251661 HTTP/1.1" status: 204 len: 168 time: 0.2673109 Nov 08 04:12:36.673895 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d7939b4-2de2-4c2e-8ae7-659b508deeeb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=53fa0a8f-81b3-40ef-838a-ae1ebc251661,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:36.675293 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51502) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:36.779125 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b285b16c-2707-457f-a1eb-017a0e6ca4a0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:36.793856 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:36.808633 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-01094217-1a8c-4acf-b3d8-ab5decc32068 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:36.810031 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-01094217-1a8c-4acf-b3d8-ab5decc32068 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "GET /v2.0/networks?id=1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 200 len: 814 time: 0.2015119 Nov 08 04:12:36.863506 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b285b16c-2707-457f-a1eb-017a0e6ca4a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:36.902144 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Request body: {'port': {'device_id': '2ad19102-59e1-43e1-97ee-7c10d6ac69c5', 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc', 'admin_state_up': True, 'tenant_id': 'f3ecedce4bce4764a6bd2e0cc60c4955'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:12:36.934946 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.008256 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b285b16c-2707-457f-a1eb-017a0e6ca4a0 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=ad5c1f2bccc54ffbb7fc331f84b89aea&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5056145 Nov 08 04:12:37.010737 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51512) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:37.024049 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['469f55bd-b66f-46d3-ac06-2dbcb2fd1255']}} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:37.026361 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b285b16c-2707-457f-a1eb-017a0e6ca4a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c75cb2b-6ebb-4e65-878e-ec38dedf8854,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:37.044474 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '524baf57-01df-4010-852f-3cb999bc7743') {'for_net_delete': True} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:37.046344 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '524baf57-01df-4010-852f-3cb999bc7743') {} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:37.063255 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4636247'] for segment, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.078759 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa5633c7-32e1-4dfd-a013-879e44ced85f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.087879 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.097983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] Releasing vlan 181 on physical network physnet1 to pool {{(pid=101665) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:12:37.098398 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6273258'] for segment, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: Traceback (most recent call last): Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: timer() Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: cb(*args, **kw) Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: return func(*args, **kwargs) Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: self._notify() Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: self.callback(batched_events) Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: event.method(event) Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: return f(self, *a, **k) Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._get(url).json() Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: return self.request(url, 'GET', **kwargs) Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:12:37.100027 dv-cinder-783643-4-iscsi neutron-server[101665]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:12:37.102156 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa5633c7-32e1-4dfd-a013-879e44ced85f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.223476 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Made reservation on behalf of f3ecedce4bce4764a6bd2e0cc60c4955 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:12:37.227068 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.269328 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa5633c7-32e1-4dfd-a013-879e44ced85f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.270515 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.272076 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa5633c7-32e1-4dfd-a013-879e44ced85f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.273222 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-aa5633c7-32e1-4dfd-a013-879e44ced85f admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/6c75cb2b-6ebb-4e65-878e-ec38dedf8854 HTTP/1.1" status: 204 len: 168 time: 0.2614999 Nov 08 04:12:37.283462 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5633c7-32e1-4dfd-a013-879e44ced85f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c75cb2b-6ebb-4e65-878e-ec38dedf8854,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:37.305075 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.308180 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] 10.222.0.21 "DELETE /v2.0/networks/469f55bd-b66f-46d3-ac06-2dbcb2fd1255 HTTP/1.1" status: 204 len: 168 time: 0.6308641 Nov 08 04:12:37.311874 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51520) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:37.325576 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d5d4c15-28a6-4599-a82c-91b8c61f65ea admin admin] Pushing event deleted for resources: {'Network': ['ID=469f55bd-b66f-46d3-ac06-2dbcb2fd1255,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:37.363326 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_v2 [None req-362e8ae1-10d1-4aae-8470-e06be6da2075 admin admin] Deleting subnet d240d600-d50d-4057-abca-52686b1ea617 {{(pid=101664) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:12:37.366535 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-362e8ae1-10d1-4aae-8470-e06be6da2075 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.401864 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Allocated IP 172.20.0.3 (1516eeae-19de-448e-9ebd-952b54f99dcc/59ccbcae-2516-4cc7-9077-478845e3e1f2/bee02b60-a424-4b49-9ecf-7f67857479a0) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:12:37.402353 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-362e8ae1-10d1-4aae-8470-e06be6da2075 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.409223 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-362e8ae1-10d1-4aae-8470-e06be6da2075 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.531318 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-362e8ae1-10d1-4aae-8470-e06be6da2075 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for subnet, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.558521 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-362e8ae1-10d1-4aae-8470-e06be6da2075 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d240d600-d50d-4057-abca-52686b1ea617,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:37.560243 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-362e8ae1-10d1-4aae-8470-e06be6da2075 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.565721 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-362e8ae1-10d1-4aae-8470-e06be6da2075 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/d240d600-d50d-4057-abca-52686b1ea617 HTTP/1.1" status: 204 len: 168 time: 0.2500575 Nov 08 04:12:37.566238 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51526) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:37.609443 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51c1a3ff-e947-4a5a-add5-0ebf798bfcf3 req-34bf3f32-15b1-4f7e-8f4e-cbc56b7b9bc7 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 210 time: 0.0655689 Nov 08 04:12:37.633066 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-527d45bc-f8c3-4f15-8a12-b93c5c0935ba req-f8d433fa-dded-49aa-b6a2-f1943b2d1ca6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:37.637105 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-527d45bc-f8c3-4f15-8a12-b93c5c0935ba req-f8d433fa-dded-49aa-b6a2-f1943b2d1ca6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.1846485 Nov 08 04:12:37.637226 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.711126 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.725758 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-527d45bc-f8c3-4f15-8a12-b93c5c0935ba req-a497fb53-27bb-488a-b84b-6747c8cf2fda tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0791488 Nov 08 04:12:37.730901 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.755243 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.755708 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.756576 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.757132 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > port after_create 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.757433 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > port after_delete 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.757855 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > port after_update 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.758786 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.758786 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.759037 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.759983 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.821759 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.828238 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.831585 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.831585 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.831585 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=101664) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 08 04:12:37.831585 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6dec1992-8266-427e-96b0-30180e9254bb']}} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:37.848311 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5635675a-dbd6-47aa-9257-bbae99978102') {'for_net_delete': True} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:37.848698 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5635675a-dbd6-47aa-9257-bbae99978102') {} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:12:37.867476 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6285915'] for segment, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.869562 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['f790fbae-e681-4e01-b1a4-67513d491300', '946fbfcb-ea3d-434f-9d42-bd6883f13e5d'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:12:37.877803 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Network 1516eeae-19de-448e-9ebd-952b54f99dcc is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:12:37.879517 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:12:37.894109 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.897048 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:12:37.901607 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Pushing event updated for resources: {'Port': ['ID=bee02b60-a424-4b49-9ecf-7f67857479a0,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:37.909900 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Releasing vlan 185 on physical network physnet1 to pool {{(pid=101664) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:12:37.910232 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5120795'] for segment, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: from cryptography.utils import int_from_bytes Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: from cryptography.utils import int_from_bytes Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: Traceback (most recent call last): Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: timer() Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: cb(*args, **kw) Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: return func(*args, **kwargs) Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: self._notify() Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: self.callback(batched_events) Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: event.method(event) Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: return f(self, *a, **k) Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._get(url).json() Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: return self.request(url, 'GET', **kwargs) Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:12:37.925033 dv-cinder-783643-4-iscsi neutron-server[101664]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:12:37.961283 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:37.962623 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.064002 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-a76d2582-b9a2-4230-aaa7-ccb48b147e82 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1977646 Nov 08 04:12:38.087291 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Request body: {'port': {'device_id': '2ad19102-59e1-43e1-97ee-7c10d6ac69c5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:12:38.090408 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.099576 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.106383 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] 10.222.0.21 "DELETE /v2.0/networks/6dec1992-8266-427e-96b0-30180e9254bb HTTP/1.1" status: 204 len: 168 time: 0.5390599 Nov 08 04:12:38.115999 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-442d0ef6-1e82-44e2-bc47-b7fb52fbed71 admin admin] Pushing event deleted for resources: {'Network': ['ID=6dec1992-8266-427e-96b0-30180e9254bb,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:38.154591 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.451325 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bee02b60-a424-4b49-9ecf-7f67857479a0 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:12:38.458791 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.470303 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Transition to ACTIVE for port object bee02b60-a424-4b49-9ecf-7f67857479a0 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:12:38.539355 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51558) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:38.595950 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-12e4cfb2-3629-4fa0-9bcd-51048d9117e8 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=eb8399a753604e5c9663ccec7bcefe8a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0554271 Nov 08 04:12:38.597203 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.599140 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51560) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:38.655195 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e4f21bbd-ff97-46ad-9dab-e61e50767c52 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.675117 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Pushing event updated for resources: {'Port': ['ID=bee02b60-a424-4b49-9ecf-7f67857479a0,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:38.678568 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e4f21bbd-ff97-46ad-9dab-e61e50767c52 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.760588 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e74a24b-d965-4353-8b30-ee6ab4156999 req-6a16d4c7-691a-4c9c-a597-27b8ecaae263 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:38.762218 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e74a24b-d965-4353-8b30-ee6ab4156999 req-6a16d4c7-691a-4c9c-a597-27b8ecaae263 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 943 time: 0.0647390 Nov 08 04:12:38.788131 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Attempting to bind port bee02b60-a424-4b49-9ecf-7f67857479a0 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:12:38.788131 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Attempting to bind port bee02b60-a424-4b49-9ecf-7f67857479a0 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:12:38.788131 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Attempting to bind port bee02b60-a424-4b49-9ecf-7f67857479a0 on network 1516eeae-19de-448e-9ebd-952b54f99dcc {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:12:38.795178 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Port bee02b60-a424-4b49-9ecf-7f67857479a0 on network 1516eeae-19de-448e-9ebd-952b54f99dcc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:12:38.795515 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Attempting to bind port bee02b60-a424-4b49-9ecf-7f67857479a0 on network 1516eeae-19de-448e-9ebd-952b54f99dcc {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:12:38.801868 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 12, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:12:38.802215 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Checking segment: {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:12:38.802640 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Bound using segment: {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:12:38.803181 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Bound port: bee02b60-a424-4b49-9ecf-7f67857479a0, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:12:38.803669 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.839010 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e4f21bbd-ff97-46ad-9dab-e61e50767c52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.841752 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e4f21bbd-ff97-46ad-9dab-e61e50767c52 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:38.845554 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e4f21bbd-ff97-46ad-9dab-e61e50767c52 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/70dc6571-d0e9-4e91-8725-d295f8997ee1 HTTP/1.1" status: 204 len: 168 time: 0.2428074 Nov 08 04:12:38.855153 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4f21bbd-ff97-46ad-9dab-e61e50767c52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70dc6571-d0e9-4e91-8725-d295f8997ee1,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:38.888525 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e74a24b-d965-4353-8b30-ee6ab4156999 req-4f35524e-2ca1-411e-a551-a8e518448943 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1168687 Nov 08 04:12:38.940223 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e16c842-fb9d-4e8a-9361-ddbb064c226b req-2237a7b6-977a-46f0-9ff1-d30c998b0575 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:38.944409 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8e16c842-fb9d-4e8a-9361-ddbb064c226b req-2237a7b6-977a-46f0-9ff1-d30c998b0575 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.1216221 Nov 08 04:12:38.948813 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] For port bee02b60-a424-4b49-9ecf-7f67857479a0, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:12:38.953226 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] For port bee02b60-a424-4b49-9ecf-7f67857479a0, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=bee02b60-a424-4b49-9ecf-7f67857479a0,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:12:39.007459 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8e16c842-fb9d-4e8a-9361-ddbb064c226b req-0627c104-6adb-46c6-a2f6-4a18ec89ba7e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560734 Nov 08 04:12:39.035718 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:39.070774 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:39.071439 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:39.073393 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] 10.222.0.16 "PUT /v2.0/ports/bee02b60-a424-4b49-9ecf-7f67857479a0 HTTP/1.1" status: 200 len: 1093 time: 0.9901986 Nov 08 04:12:39.073828 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2ad19102-59e1-43e1-97ee-7c10d6ac69c5', 'tag': 'bee02b60-a424-4b49-9ecf-7f67857479a0'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:12:39.076225 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c8c7706-f450-4448-ad44-913e7ab3e250" -d '{"events": [{"name": "network-changed", "server_uuid": "2ad19102-59e1-43e1-97ee-7c10d6ac69c5", "tag": "bee02b60-a424-4b49-9ecf-7f67857479a0"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:12:39.106163 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8ca4f1-c9b7-4bd5-a8b0-526963d4ae65 service neutron] Pushing event updated for resources: {'Port': ['ID=bee02b60-a424-4b49-9ecf-7f67857479a0,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:39.122785 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:12:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61c111b2-cab4-4fe0-abfd-75c8b1c73d04 x-openstack-request-id: req-61c111b2-cab4-4fe0-abfd-75c8b1c73d04 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:12:39.123082 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2ad19102-59e1-43e1-97ee-7c10d6ac69c5", "tag": "bee02b60-a424-4b49-9ecf-7f67857479a0", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:12:39.126694 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-61c111b2-cab4-4fe0-abfd-75c8b1c73d04 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:12:39.127140 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2ad19102-59e1-43e1-97ee-7c10d6ac69c5', 'tag': 'bee02b60-a424-4b49-9ecf-7f67857479a0', 'status': 'completed', 'code': 200} Nov 08 04:12:39.244546 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8c7706-f450-4448-ad44-913e7ab3e250 req-803920b6-cd1a-470f-9f61-600ea153b9a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:39.246069 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c8c7706-f450-4448-ad44-913e7ab3e250 req-803920b6-cd1a-470f-9f61-600ea153b9a1 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 1096 time: 0.0518072 Nov 08 04:12:39.517651 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51596) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:39.562008 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8c7706-f450-4448-ad44-913e7ab3e250 req-72cc012e-378c-4c6f-adea-73429342eefb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:39.563628 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c8c7706-f450-4448-ad44-913e7ab3e250 req-72cc012e-378c-4c6f-adea-73429342eefb service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&shared=False HTTP/1.1" status: 200 len: 915 time: 0.2990718 Nov 08 04:12:39.566198 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-bd66ccec-0c9e-44ae-be02-1bd33d48b3c3 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=a1695abd1409467a958656620ff06192&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0466588 Nov 08 04:12:39.568888 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51598) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:39.629027 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e1ee9c5-3eda-48b6-9068-b9b680418109 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:39.651762 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e1ee9c5-3eda-48b6-9068-b9b680418109 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:39.669681 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8c7706-f450-4448-ad44-913e7ab3e250 req-a8a42a3d-ed16-4b93-ad50-9224a1e033e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:39.671168 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c8c7706-f450-4448-ad44-913e7ab3e250 req-a8a42a3d-ed16-4b93-ad50-9224a1e033e7 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1004369 Nov 08 04:12:39.789360 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e1ee9c5-3eda-48b6-9068-b9b680418109 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:39.792661 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5e1ee9c5-3eda-48b6-9068-b9b680418109 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:39.793497 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-228b35b7-029d-404a-990f-df674c59a218 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:39.793836 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-5e1ee9c5-3eda-48b6-9068-b9b680418109 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/b3d24fb3-3ca4-437f-a2db-0ec472daf62b HTTP/1.1" status: 204 len: 168 time: 0.2240622 Nov 08 04:12:39.794999 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-228b35b7-029d-404a-990f-df674c59a218 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 1096 time: 0.0419180 Nov 08 04:12:39.802243 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1ee9c5-3eda-48b6-9068-b9b680418109 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3d24fb3-3ca4-437f-a2db-0ec472daf62b,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:39.864328 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-8994aa12-8bab-4ccd-9146-8838eb56e5aa service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=bee02b60-a424-4b49-9ecf-7f67857479a0 HTTP/1.1" status: 200 len: 217 time: 0.0410423 Nov 08 04:12:39.918379 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-7c8c3e11-6ee4-4bd1-85de-830a1870bab8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:39.919971 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-7c8c3e11-6ee4-4bd1-85de-830a1870bab8 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=59ccbcae-2516-4cc7-9077-478845e3e1f2 HTTP/1.1" status: 200 len: 854 time: 0.0460653 Nov 08 04:12:39.958394 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-3d8213e6-81f8-4a77-9778-5afa76aa605b service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1516eeae-19de-448e-9ebd-952b54f99dcc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0233338 Nov 08 04:12:40.069924 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b144f4a-3954-482b-863d-b9558e558337 req-c59f6e2a-7284-4b39-b7ea-ddf986a1df68 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:40.071530 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b144f4a-3954-482b-863d-b9558e558337 req-c59f6e2a-7284-4b39-b7ea-ddf986a1df68 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 943 time: 0.1092749 Nov 08 04:12:40.147146 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-9bbf8cd5-fd33-4c2d-ac31-633d26082a0a service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1753960 Nov 08 04:12:40.232742 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b144f4a-3954-482b-863d-b9558e558337 req-b359d6e2-122f-4a4c-9df8-b276d226691c tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1532190 Nov 08 04:12:40.244321 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb388254-1133-42ca-bd40-e17e07ff2437 req-d734216d-c0f2-4387-a220-a051f79b7614 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:40.245780 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb388254-1133-42ca-bd40-e17e07ff2437 req-d734216d-c0f2-4387-a220-a051f79b7614 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.1541820 Nov 08 04:12:40.311329 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81c9b3d4-3f87-4336-a419-109b9de5b3f3 req-25fee0bb-2e01-48b1-9a41-053628cd63e7 service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1526222 Nov 08 04:12:40.329052 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb388254-1133-42ca-bd40-e17e07ff2437 req-c794f213-30c3-48da-b2ac-9cfe49d48166 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717926 Nov 08 04:12:41.397997 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b0e3d5-737a-47f4-933b-38fc6fbf69b5 req-15b2a366-7e35-41b7-9e89-59335a7d7e39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:41.552438 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02b0e3d5-737a-47f4-933b-38fc6fbf69b5 req-15b2a366-7e35-41b7-9e89-59335a7d7e39 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 943 time: 0.0763476 Nov 08 04:12:41.552438 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02b0e3d5-737a-47f4-933b-38fc6fbf69b5 req-70757e25-1bb4-46d7-9f25-ec4346c06fde tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752268 Nov 08 04:12:41.552438 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ba7f64-e0de-4b4a-812b-2e194ea571c3 req-13db163b-748d-48e0-979a-f6d90ad21b2d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:41.552438 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31ba7f64-e0de-4b4a-812b-2e194ea571c3 req-13db163b-748d-48e0-979a-f6d90ad21b2d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0749154 Nov 08 04:12:41.552438 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31ba7f64-e0de-4b4a-812b-2e194ea571c3 req-74bafe65-f5cb-4125-9f37-26bd40180ea4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412688 Nov 08 04:12:42.663379 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-abd67c8b-d86d-40a9-a9ce-5daa61d1b534 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:42.698531 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-076c9a1f-d52f-47ca-bbeb-5d62037cf8f7 req-24e8e269-bdb4-4445-8e43-da9e69c17e18 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:42.700333 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-076c9a1f-d52f-47ca-bbeb-5d62037cf8f7 req-24e8e269-bdb4-4445-8e43-da9e69c17e18 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 943 time: 0.0822721 Nov 08 04:12:42.708303 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b011ffd-2a18-4a65-b072-929c5cb9261d req-bf950bfc-89e2-456f-bed4-1b54f48d5f56 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:42.709746 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1b011ffd-2a18-4a65-b072-929c5cb9261d req-bf950bfc-89e2-456f-bed4-1b54f48d5f56 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0801888 Nov 08 04:12:42.784970 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-076c9a1f-d52f-47ca-bbeb-5d62037cf8f7 req-27a22bec-b65e-4faf-a22b-92789b63853a tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742621 Nov 08 04:12:42.789541 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1b011ffd-2a18-4a65-b072-929c5cb9261d req-7d3d361d-5c78-4a99-ae44-0e7c65e835ae tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731544 Nov 08 04:12:43.832861 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51712) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:43.936131 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f1c8a238-b906-4bb8-828b-e5b638ba41e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:44.007565 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f1c8a238-b906-4bb8-828b-e5b638ba41e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:44.072400 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f1c8a238-b906-4bb8-828b-e5b638ba41e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:44.109253 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1c8a238-b906-4bb8-828b-e5b638ba41e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6cb87599-5385-46b1-b5c4-0cdc9853d3b4,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:44.113753 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f1c8a238-b906-4bb8-828b-e5b638ba41e4 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=4ea2c8fd4af047ccae1206018fc9f1c0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2798181 Nov 08 04:12:44.116476 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51716) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:44.167459 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-12646dda-4e10-4f9d-bf11-0b75ff0f25f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:44.188842 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-12646dda-4e10-4f9d-bf11-0b75ff0f25f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:44.307352 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-12646dda-4e10-4f9d-bf11-0b75ff0f25f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:44.309934 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-12646dda-4e10-4f9d-bf11-0b75ff0f25f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:44.311129 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-12646dda-4e10-4f9d-bf11-0b75ff0f25f6 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/6cb87599-5385-46b1-b5c4-0cdc9853d3b4 HTTP/1.1" status: 204 len: 168 time: 0.1937327 Nov 08 04:12:44.319421 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12646dda-4e10-4f9d-bf11-0b75ff0f25f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6cb87599-5385-46b1-b5c4-0cdc9853d3b4,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:44.658038 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device bee02b60-a424-4b49-9ecf-7f67857479a0 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:12:44.757704 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port bee02b60-a424-4b49-9ecf-7f67857479a0, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=bee02b60-a424-4b49-9ecf-7f67857479a0,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:12:44.768729 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'bee02b60-a424-4b49-9ecf-7f67857479a0', 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc', 'port_id': 'bee02b60-a424-4b49-9ecf-7f67857479a0', 'mac_address': 'fa:16:3e:a9:45:20', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59ccbcae-2516-4cc7-9077-478845e3e1f2', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:12:44.805037 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:44.817261 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bee02b60-a424-4b49-9ecf-7f67857479a0 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:12:44.838681 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port bee02b60-a424-4b49-9ecf-7f67857479a0, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=bee02b60-a424-4b49-9ecf-7f67857479a0,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:12:44.926327 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:44.975582 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=bee02b60-a424-4b49-9ecf-7f67857479a0,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:45.117958 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-53b3ceb8-0414-48c2-bd26-f8e80c736246 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:45.890328 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de9aec97-14d7-406d-b8d4-a7e0aaf90c92 req-b49ce015-1337-4b19-91e7-91597d04058d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:45.891951 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de9aec97-14d7-406d-b8d4-a7e0aaf90c92 req-b49ce015-1337-4b19-91e7-91597d04058d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0551476 Nov 08 04:12:45.929474 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:45.945558 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de9aec97-14d7-406d-b8d4-a7e0aaf90c92 req-b66b9914-fb86-4d26-81da-467dd798f393 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468676 Nov 08 04:12:45.996374 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e521703-664e-4cf0-ae8b-dae52a02db5e req-cc14464e-9053-43ef-8588-ed9c51a8f472 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:45.997989 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2e521703-664e-4cf0-ae8b-dae52a02db5e req-cc14464e-9053-43ef-8588-ed9c51a8f472 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 944 time: 0.0569966 Nov 08 04:12:46.046639 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2e521703-664e-4cf0-ae8b-dae52a02db5e req-3e0e0b94-c7bb-4e5d-b4be-e3aabd65f1f0 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425572 Nov 08 04:12:46.150896 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['bee02b60-a424-4b49-9ecf-7f67857479a0'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:12:47.071126 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc410d57-235f-4252-9b0a-77d55f2c89d9 req-e7216e67-be4b-4817-98c2-1ffd1b70d73f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:47.073290 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dc410d57-235f-4252-9b0a-77d55f2c89d9 req-e7216e67-be4b-4817-98c2-1ffd1b70d73f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0572600 Nov 08 04:12:47.164395 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dc410d57-235f-4252-9b0a-77d55f2c89d9 req-da60bfbe-bab1-4ea1-95a4-78c19d376a36 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809062 Nov 08 04:12:47.183981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8873e464-13f6-498e-8920-1032aaa8d601 req-971ace6f-2e53-4a70-a892-f1d79edf9708 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:47.185424 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8873e464-13f6-498e-8920-1032aaa8d601 req-971ace6f-2e53-4a70-a892-f1d79edf9708 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 944 time: 0.0609593 Nov 08 04:12:47.234043 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8873e464-13f6-498e-8920-1032aaa8d601 req-7617a15b-7872-44ff-96db-8454a9ccdff0 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426908 Nov 08 04:12:47.583422 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:47.679237 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device bee02b60-a424-4b49-9ecf-7f67857479a0 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:12:47.840304 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port bee02b60-a424-4b49-9ecf-7f67857479a0 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:12:47.844355 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port bee02b60-a424-4b49-9ecf-7f67857479a0 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:12:47.844748 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:47.922382 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:47.949646 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ad19102-59e1-43e1-97ee-7c10d6ac69c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bee02b60-a424-4b49-9ecf-7f67857479a0'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:12:47.952332 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8147f84b-90ea-45cb-a3dd-648851d32fe8" -d '{"events": [{"server_uuid": "2ad19102-59e1-43e1-97ee-7c10d6ac69c5", "name": "network-vif-plugged", "status": "completed", "tag": "bee02b60-a424-4b49-9ecf-7f67857479a0"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:12:47.969652 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port bee02b60-a424-4b49-9ecf-7f67857479a0, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=bee02b60-a424-4b49-9ecf-7f67857479a0,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:12:47.994950 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:12:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-064bc58c-9ad0-4883-a3e3-3f4fbbf5dc0e x-openstack-request-id: req-064bc58c-9ad0-4883-a3e3-3f4fbbf5dc0e {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:12:47.995268 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ad19102-59e1-43e1-97ee-7c10d6ac69c5", "name": "network-vif-plugged", "status": "completed", "tag": "bee02b60-a424-4b49-9ecf-7f67857479a0", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:12:47.995519 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-064bc58c-9ad0-4883-a3e3-3f4fbbf5dc0e {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:12:47.997976 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ad19102-59e1-43e1-97ee-7c10d6ac69c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bee02b60-a424-4b49-9ecf-7f67857479a0', 'code': 200} Nov 08 04:12:48.046437 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:48.097622 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=bee02b60-a424-4b49-9ecf-7f67857479a0,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:48.131878 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51812) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:48.237005 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-54aee912-ea79-493f-8755-3205187f0318 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:48.315302 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-54aee912-ea79-493f-8755-3205187f0318 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:48.369337 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:48.392109 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-54aee912-ea79-493f-8755-3205187f0318 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:48.436092 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-54aee912-ea79-493f-8755-3205187f0318 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=15728b3b75d94df58f002e6134504d68&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3031201 Nov 08 04:12:48.436958 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54aee912-ea79-493f-8755-3205187f0318 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dab1bd6e-733f-4222-bf9f-ca6bb47cedfe,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:48.439602 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51820) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:48.490589 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f676fd5b-709d-46ed-a7c8-1650011bc38b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:48.512569 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f676fd5b-709d-46ed-a7c8-1650011bc38b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:48.649952 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f676fd5b-709d-46ed-a7c8-1650011bc38b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:48.652564 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f676fd5b-709d-46ed-a7c8-1650011bc38b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:48.653723 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f676fd5b-709d-46ed-a7c8-1650011bc38b admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/dab1bd6e-733f-4222-bf9f-ca6bb47cedfe HTTP/1.1" status: 204 len: 168 time: 0.2130852 Nov 08 04:12:48.661749 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f676fd5b-709d-46ed-a7c8-1650011bc38b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dab1bd6e-733f-4222-bf9f-ca6bb47cedfe,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:49.210419 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 51832) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:49.223291 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-cc03dabd-aa30-4eba-9cad-a386e94fd1fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:49.294769 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-cc03dabd-aa30-4eba-9cad-a386e94fd1fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:49.383075 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-cc03dabd-aa30-4eba-9cad-a386e94fd1fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:49.421271 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-cc03dabd-aa30-4eba-9cad-a386e94fd1fe admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=71b3d43cce3e4dde88beebe4ea063c32&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2097392 Nov 08 04:12:49.422119 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc03dabd-aa30-4eba-9cad-a386e94fd1fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d27725d-4f1b-43fa-ac81-c7f8adbd0eed,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:49.424139 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 51834) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:12:49.470647 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ab4500ae-036f-4391-b0a8-099ae20e6d9f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:49.491381 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ab4500ae-036f-4391-b0a8-099ae20e6d9f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:49.583498 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ab4500ae-036f-4391-b0a8-099ae20e6d9f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:49.586002 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ab4500ae-036f-4391-b0a8-099ae20e6d9f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:49.587177 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ab4500ae-036f-4391-b0a8-099ae20e6d9f admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/8d27725d-4f1b-43fa-ac81-c7f8adbd0eed HTTP/1.1" status: 204 len: 168 time: 0.1620412 Nov 08 04:12:49.595935 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab4500ae-036f-4391-b0a8-099ae20e6d9f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d27725d-4f1b-43fa-ac81-c7f8adbd0eed,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:12:51.063888 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82fb3149-f71e-4d25-a2e6-9da41c0a5599 req-43b37dbe-b699-4fcb-84f7-3ca5f1ccc772 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:51.065389 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-82fb3149-f71e-4d25-a2e6-9da41c0a5599 req-43b37dbe-b699-4fcb-84f7-3ca5f1ccc772 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0540271 Nov 08 04:12:51.147701 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-82fb3149-f71e-4d25-a2e6-9da41c0a5599 req-9187da07-89bb-46ae-9c45-8e9bf672ee6f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761585 Nov 08 04:12:51.155791 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53663a64-c971-44e6-bd76-0429e7057c7a req-2b26fcae-4cba-426a-bbf5-9b8a99b2ab24 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:51.157180 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-53663a64-c971-44e6-bd76-0429e7057c7a req-2b26fcae-4cba-426a-bbf5-9b8a99b2ab24 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 945 time: 0.0796402 Nov 08 04:12:51.209960 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-53663a64-c971-44e6-bd76-0429e7057c7a req-836670d6-d00b-4b9e-ade6-19cb450157d7 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430543 Nov 08 04:12:51.292289 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35db8532-7e98-47bc-8214-706e3dd34959 req-0473ae8a-ed1f-451c-9ed8-eb46ad7c8115 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:51.293822 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-35db8532-7e98-47bc-8214-706e3dd34959 req-0473ae8a-ed1f-451c-9ed8-eb46ad7c8115 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 1098 time: 0.0390220 Nov 08 04:12:51.341119 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-35db8532-7e98-47bc-8214-706e3dd34959 req-e7cd8399-b683-49db-845c-4c8b9df3ffe8 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397573 Nov 08 04:12:54.166562 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:12:54.833393 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-037d3042-9648-4bf1-be77-e855da3a7eef req-a90c280b-b802-4489-be2c-e30a9394914e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:54.834760 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-037d3042-9648-4bf1-be77-e855da3a7eef req-a90c280b-b802-4489-be2c-e30a9394914e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0536704 Nov 08 04:12:54.920090 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-018f2bc0-d782-4036-bcef-56709ee8abf5 req-fee2095e-5e02-4aef-b85f-e9693ca66fda tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:54.921557 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-018f2bc0-d782-4036-bcef-56709ee8abf5 req-fee2095e-5e02-4aef-b85f-e9693ca66fda tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 945 time: 0.0812602 Nov 08 04:12:54.926204 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-037d3042-9648-4bf1-be77-e855da3a7eef req-9003b8ab-4ed6-486d-b4ef-7191a90d6c82 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762222 Nov 08 04:12:54.970625 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-018f2bc0-d782-4036-bcef-56709ee8abf5 req-af4d5d95-6eff-42e1-b286-ba077c62aa14 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424888 Nov 08 04:12:59.851013 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-779aa028-f390-4de8-a0c9-3eb182720975 req-faa1b5b2-3f0d-41c6-8b0c-4ff7b52dcdee tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:59.852478 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-779aa028-f390-4de8-a0c9-3eb182720975 req-faa1b5b2-3f0d-41c6-8b0c-4ff7b52dcdee tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0466764 Nov 08 04:12:59.928495 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-779aa028-f390-4de8-a0c9-3eb182720975 req-82ab944e-913e-4295-83f9-6ca19e02ef7e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694537 Nov 08 04:12:59.940461 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6489193a-ff3a-401d-8f43-a937b9fe86f9 req-51a242dc-676b-4fc9-be87-7612d8e91b56 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:12:59.941864 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6489193a-ff3a-401d-8f43-a937b9fe86f9 req-51a242dc-676b-4fc9-be87-7612d8e91b56 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 945 time: 0.0700386 Nov 08 04:12:59.988931 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6489193a-ff3a-401d-8f43-a937b9fe86f9 req-06fe27ce-a85a-4ac3-b178-9ee6c9477412 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407820 Nov 08 04:13:00.331270 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a98b06dc-9ded-4f42-a65c-ee3162cca36b req-4c0e1ffc-f759-4c0e-a75d-7a85e85d73aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:00.332797 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a98b06dc-9ded-4f42-a65c-ee3162cca36b req-4c0e1ffc-f759-4c0e-a75d-7a85e85d73aa service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 1098 time: 0.0389965 Nov 08 04:13:00.379538 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a98b06dc-9ded-4f42-a65c-ee3162cca36b req-132ff851-1f48-410d-8d0e-0b7927c1ea3a service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0363569 Nov 08 04:13:04.097310 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f652c6c4-931b-4bd4-9285-fc126dd6c74d req-868d8f54-6d2e-4b93-a510-ab83f99135a0 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:04.098783 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f652c6c4-931b-4bd4-9285-fc126dd6c74d req-868d8f54-6d2e-4b93-a510-ab83f99135a0 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0499597 Nov 08 04:13:04.146780 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f652c6c4-931b-4bd4-9285-fc126dd6c74d req-fe0d2328-a462-4b39-91fe-cdc799106297 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409110 Nov 08 04:13:05.548735 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a41138d0-9bb6-4ab5-a74c-9c76be76b864 req-0235585e-0089-4aa1-9aa9-66434cb412f1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:05.550195 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a41138d0-9bb6-4ab5-a74c-9c76be76b864 req-0235585e-0089-4aa1-9aa9-66434cb412f1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0483618 Nov 08 04:13:05.601987 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a41138d0-9bb6-4ab5-a74c-9c76be76b864 req-338ddc46-8026-442e-b398-a79e664aeea0 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457075 Nov 08 04:13:05.705013 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 52092) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:05.808554 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a5efd8cd-2091-419b-a9eb-6d9f174c62f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:05.884386 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a5efd8cd-2091-419b-a9eb-6d9f174c62f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:05.959684 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a5efd8cd-2091-419b-a9eb-6d9f174c62f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:05.997619 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a5efd8cd-2091-419b-a9eb-6d9f174c62f2 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=3bd6f5c9420c4c51ae2d4a755350c700&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2913170 Nov 08 04:13:06.000404 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5efd8cd-2091-419b-a9eb-6d9f174c62f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c7c38d72-8d37-49b1-81a1-b07217206d1e,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:06.001670 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 52102) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:06.050072 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ba617852-65d7-4773-9bae-bf0bb99ed8d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:06.070979 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ba617852-65d7-4773-9bae-bf0bb99ed8d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:06.191679 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ba617852-65d7-4773-9bae-bf0bb99ed8d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:06.194236 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ba617852-65d7-4773-9bae-bf0bb99ed8d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:06.195396 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ba617852-65d7-4773-9bae-bf0bb99ed8d8 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/c7c38d72-8d37-49b1-81a1-b07217206d1e HTTP/1.1" status: 204 len: 168 time: 0.1919742 Nov 08 04:13:06.202971 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba617852-65d7-4773-9bae-bf0bb99ed8d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7c38d72-8d37-49b1-81a1-b07217206d1e,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:06.724783 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1567dadb-5638-4533-b7ea-c43d09f0c491 req-ba9155ed-6c09-46ab-8895-778d4014946f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:06.726215 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1567dadb-5638-4533-b7ea-c43d09f0c491 req-ba9155ed-6c09-46ab-8895-778d4014946f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0478044 Nov 08 04:13:06.773662 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1567dadb-5638-4533-b7ea-c43d09f0c491 req-ab3c1d57-7f8b-4ac5-ba4a-ad1c5bc503e3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409174 Nov 08 04:13:06.891211 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e637e2c-456f-4121-b321-15ca9ef72e71 req-499692c4-be39-4118-8491-e4c9fbd7e9e3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:06.892688 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8e637e2c-456f-4121-b321-15ca9ef72e71 req-499692c4-be39-4118-8491-e4c9fbd7e9e3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0476122 Nov 08 04:13:06.939541 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8e637e2c-456f-4121-b321-15ca9ef72e71 req-ddc061e1-1b5e-4b56-a6cc-98d5a2b70cc9 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410085 Nov 08 04:13:11.287790 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a559548-1310-4e87-a294-7a4d2263a0fa req-06ac4433-60ac-46a9-8cef-bc346f7e9c9e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:11.289270 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a559548-1310-4e87-a294-7a4d2263a0fa req-06ac4433-60ac-46a9-8cef-bc346f7e9c9e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0498509 Nov 08 04:13:11.336579 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a559548-1310-4e87-a294-7a4d2263a0fa req-611f1c3d-ebfb-4e59-b9dc-c488687d078e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409276 Nov 08 04:13:12.708304 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-ba2c7086-6149-48c6-ba57-87a7797653e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:12.967946 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:13:14.067512 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51607ec6-6d25-44bb-acb0-36d646fb44d3 req-e4114622-3eb9-44ad-954a-02f3b6988895 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:14.069067 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51607ec6-6d25-44bb-acb0-36d646fb44d3 req-e4114622-3eb9-44ad-954a-02f3b6988895 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 1098 time: 0.0386064 Nov 08 04:13:14.242105 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7ee748-7793-4832-be83-e72aa006afa9 req-a3ac0f61-07dd-4837-acb9-5734adfdf17e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:14.243574 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ec7ee748-7793-4832-be83-e72aa006afa9 req-a3ac0f61-07dd-4837-acb9-5734adfdf17e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0916088 Nov 08 04:13:14.267160 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51607ec6-6d25-44bb-acb0-36d646fb44d3 req-c59e9b43-5a70-4e45-a582-db6254b71809 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:14.268541 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51607ec6-6d25-44bb-acb0-36d646fb44d3 req-c59e9b43-5a70-4e45-a582-db6254b71809 service neutron] 10.222.0.16 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 920 time: 0.1342599 Nov 08 04:13:14.323080 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51607ec6-6d25-44bb-acb0-36d646fb44d3 req-6dbc8a7e-b51c-4332-8291-5a61968bb4e8 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000 HTTP/1.1" status: 200 len: 217 time: 0.0426321 Nov 08 04:13:14.329916 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ec7ee748-7793-4832-be83-e72aa006afa9 req-e7395d29-9187-47fe-b08a-701dd1c39f90 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0776217 Nov 08 04:13:14.385359 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51607ec6-6d25-44bb-acb0-36d646fb44d3 req-e50eb9ae-9bb7-40cf-b260-4c08cea5adec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:14.386783 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51607ec6-6d25-44bb-acb0-36d646fb44d3 req-e50eb9ae-9bb7-40cf-b260-4c08cea5adec service neutron] 10.222.0.16 "GET /v2.0/subnets?id=900a12a5-1baa-47e1-8b64-245dc70bc9f2 HTTP/1.1" status: 200 len: 859 time: 0.0428624 Nov 08 04:13:14.422809 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51607ec6-6d25-44bb-acb0-36d646fb44d3 req-75be2138-81f1-46a7-86f6-6fc579c72b2f service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0247328 Nov 08 04:13:14.522942 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51607ec6-6d25-44bb-acb0-36d646fb44d3 req-4f78410c-7279-4462-9040-0c6c2f336aa7 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856984 Nov 08 04:13:14.617766 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51607ec6-6d25-44bb-acb0-36d646fb44d3 req-24557723-3016-4f68-a1d5-5c479c547a54 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833452 Nov 08 04:13:15.128655 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bfc53efe-a2af-4662-a898-4eb2f9d81669 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:15.985268 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:17.593930 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:17.695059 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d100b915-404d-40fb-a64a-4b44d3caaaa7 req-9284d888-c0bb-4a70-8402-abe1a516448e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:17.696527 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d100b915-404d-40fb-a64a-4b44d3caaaa7 req-9284d888-c0bb-4a70-8402-abe1a516448e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0508440 Nov 08 04:13:17.746756 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d100b915-404d-40fb-a64a-4b44d3caaaa7 req-376d1691-3641-47d1-b196-5cb8418163a2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442464 Nov 08 04:13:18.376568 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:18.862455 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1d857a-01be-46d1-96d6-ec1003c724cc req-f810e808-3fb8-4ce8-9be0-6eab9a182249 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:18.864145 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f1d857a-01be-46d1-96d6-ec1003c724cc req-f810e808-3fb8-4ce8-9be0-6eab9a182249 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0474904 Nov 08 04:13:18.914524 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f1d857a-01be-46d1-96d6-ec1003c724cc req-de9e3155-dc2f-4612-90c5-f8cde792469b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445995 Nov 08 04:13:22.887260 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b782f2aa-9d3e-40c0-a865-b6f2d7c76e66 req-b90e8f37-9df2-40ae-bcbd-99ad77db450b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:22.888719 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b782f2aa-9d3e-40c0-a865-b6f2d7c76e66 req-b90e8f37-9df2-40ae-bcbd-99ad77db450b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0472388 Nov 08 04:13:22.935671 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b782f2aa-9d3e-40c0-a865-b6f2d7c76e66 req-a8ebfc5b-3c1a-4a1a-9a4c-03400f4abdbd tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409565 Nov 08 04:13:24.075109 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1045d508-08cd-4e27-b7ce-378d81e378c1 req-1cd51a4a-c682-4b7a-affa-eba5e77bf51f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:24.076751 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1045d508-08cd-4e27-b7ce-378d81e378c1 req-1cd51a4a-c682-4b7a-affa-eba5e77bf51f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0513818 Nov 08 04:13:24.126665 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1045d508-08cd-4e27-b7ce-378d81e378c1 req-e595b0f7-3ca1-48f6-bacd-49ceeab8118b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440226 Nov 08 04:13:24.156948 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:24.551166 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b49386c-2df9-43c9-a5e7-7c7b09b6880d req-b24e9d52-0c5e-42af-84d4-e396cd575eb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:24.552658 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b49386c-2df9-43c9-a5e7-7c7b09b6880d req-b24e9d52-0c5e-42af-84d4-e396cd575eb9 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 1098 time: 0.0393934 Nov 08 04:13:24.662987 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b49386c-2df9-43c9-a5e7-7c7b09b6880d req-f38b7d1e-aada-4acd-adc3-b26061af9340 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:24.664521 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b49386c-2df9-43c9-a5e7-7c7b09b6880d req-f38b7d1e-aada-4acd-adc3-b26061af9340 service neutron] 10.222.0.16 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 920 time: 0.0866463 Nov 08 04:13:24.711037 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b49386c-2df9-43c9-a5e7-7c7b09b6880d req-26e2c66d-4436-45b4-be03-e56ae8db34e7 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000 HTTP/1.1" status: 200 len: 217 time: 0.0376942 Nov 08 04:13:24.763060 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b49386c-2df9-43c9-a5e7-7c7b09b6880d req-253f4ec1-b154-41fa-8203-4d6bdaefaf64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:24.764445 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b49386c-2df9-43c9-a5e7-7c7b09b6880d req-253f4ec1-b154-41fa-8203-4d6bdaefaf64 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=900a12a5-1baa-47e1-8b64-245dc70bc9f2 HTTP/1.1" status: 200 len: 859 time: 0.0417278 Nov 08 04:13:24.795542 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b49386c-2df9-43c9-a5e7-7c7b09b6880d req-fabe4d96-26fd-4047-95b4-e036943a671d service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0229645 Nov 08 04:13:24.891612 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b49386c-2df9-43c9-a5e7-7c7b09b6880d req-f6b66ac9-4331-4d0e-8fab-f765fd4d08b5 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877073 Nov 08 04:13:24.990098 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b49386c-2df9-43c9-a5e7-7c7b09b6880d req-a815521f-297d-4eaa-a39e-82c7766b2a95 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860345 Nov 08 04:13:25.291142 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8975cfb0-a75e-485e-bc5c-1a43605c6ddd req-92995b41-59c4-414b-ad53-6a80c36d2a78 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:25.293278 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8975cfb0-a75e-485e-bc5c-1a43605c6ddd req-92995b41-59c4-414b-ad53-6a80c36d2a78 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0557022 Nov 08 04:13:25.341569 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8975cfb0-a75e-485e-bc5c-1a43605c6ddd req-dcf22d34-1d40-4691-a2bd-c20ff1502797 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417728 Nov 08 04:13:25.768578 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-4654ff4a-ca8e-4e70-8172-166940ff1206 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:25.770373 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-4654ff4a-ca8e-4e70-8172-166940ff1206 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/networks?id=1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 200 len: 814 time: 0.1043241 Nov 08 04:13:25.785741 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-9afe8564-beb0-4ca9-a436-7cc5b8edab86 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/quotas/f3ecedce4bce4764a6bd2e0cc60c4955 HTTP/1.1" status: 200 len: 375 time: 0.0097332 Nov 08 04:13:25.837363 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-4a2ce507-bdc9-4a07-8718-4b88dad7c240 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0459197 Nov 08 04:13:25.929832 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-ff1a9abe-ba9c-40f7-b200-7e0bb31d8a46 service neutron] 10.222.0.21 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846853 Nov 08 04:13:26.019450 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-e6443254-9516-49f6-bfce-c6a2d3e5a653 service neutron] 10.222.0.21 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835006 Nov 08 04:13:26.262283 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea5e3fdf-f862-497c-aed4-61247c284083 req-024045a3-5e9f-43d9-bfda-2d61d6c71f7d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 210 time: 0.0276427 Nov 08 04:13:26.458090 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a4e954-51fe-449d-97de-d01f2775d7a1 req-af0e1029-9317-475d-a889-594ee464fb84 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:26.460481 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43a4e954-51fe-449d-97de-d01f2775d7a1 req-af0e1029-9317-475d-a889-594ee464fb84 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0491569 Nov 08 04:13:26.717677 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43a4e954-51fe-449d-97de-d01f2775d7a1 req-f764d1d0-ea14-4ac5-9d42-316661200e12 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2501159 Nov 08 04:13:27.359126 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d6335d4a-8a03-4b69-9208-56256d7cfa21 req-c7edaed4-02e9-43fa-bea6-5755f19c9827 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 210 time: 0.0284269 Nov 08 04:13:27.836839 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-671dae95-3276-4afe-9da8-4dff6e4e1375 req-ac31ef3e-7548-4203-9701-cdbbf33fb376 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:27.838264 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-671dae95-3276-4afe-9da8-4dff6e4e1375 req-ac31ef3e-7548-4203-9701-cdbbf33fb376 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0464134 Nov 08 04:13:27.883101 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-671dae95-3276-4afe-9da8-4dff6e4e1375 req-4766ffb4-efe8-4f5b-8c1b-483c693d085d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384843 Nov 08 04:13:28.452266 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9384187b-24bc-4052-92de-cca419c6aa2e req-af1b3b43-cd52-4fa9-a291-c6c88760f812 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 210 time: 0.0254979 Nov 08 04:13:30.681915 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d4b1971f-4e94-4d5a-91b0-ec1670010a62 req-33acddc7-a608-48c7-934f-e229f3260bf5 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 210 time: 0.0427694 Nov 08 04:13:30.701708 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d45b5d-bbd3-4322-83d8-a533fc575e7f req-15a6124c-6699-490b-9553-f94c2746cae3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:30.703064 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-09d45b5d-bbd3-4322-83d8-a533fc575e7f req-15a6124c-6699-490b-9553-f94c2746cae3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0776992 Nov 08 04:13:30.750046 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-09d45b5d-bbd3-4322-83d8-a533fc575e7f req-7f741880-8d2b-48b8-9060-f14fde57a7ba tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413740 Nov 08 04:13:31.296859 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-4b614305-7fe3-4e8e-a355-5229d214f001 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:31.298300 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-4b614305-7fe3-4e8e-a355-5229d214f001 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "GET /v2.0/networks?id=1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 200 len: 814 time: 0.1029308 Nov 08 04:13:31.330041 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Request body: {'port': {'device_id': '81fe6aff-1d2b-4fb2-9774-590ad1d532f1', 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc', 'admin_state_up': True, 'tenant_id': 'f3ecedce4bce4764a6bd2e0cc60c4955'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:13:31.544989 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Made reservation on behalf of f3ecedce4bce4764a6bd2e0cc60c4955 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:13:31.548549 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:31.680530 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Allocated IP 172.20.0.10 (1516eeae-19de-448e-9ebd-952b54f99dcc/59ccbcae-2516-4cc7-9077-478845e3e1f2/dc646599-8d18-41a0-9c3c-c4891c0f0c7c) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:13:31.810292 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5d9f50c-7a24-43d7-8eec-8a3b0288412b req-261d50df-499a-4dda-be79-7f358ee44c62 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 210 time: 0.0299425 Nov 08 04:13:31.883478 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:31.904671 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe46c03-23fc-49e3-b56f-d38a5bd6b576 req-74c79d79-1550-40b0-92aa-c54922eaa328 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:31.906181 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2fe46c03-23fc-49e3-b56f-d38a5bd6b576 req-74c79d79-1550-40b0-92aa-c54922eaa328 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0841279 Nov 08 04:13:31.978918 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2fe46c03-23fc-49e3-b56f-d38a5bd6b576 req-45da868d-726d-4b33-a22d-14229491ca5d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644507 Nov 08 04:13:32.043408 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:32.086860 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Network 1516eeae-19de-448e-9ebd-952b54f99dcc is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:13:32.090455 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:13:32.096453 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:13:32.097371 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['f790fbae-e681-4e01-b1a4-67513d491300', '946fbfcb-ea3d-434f-9d42-bd6883f13e5d', 'bee02b60-a424-4b49-9ecf-7f67857479a0'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:13:32.123856 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Pushing event updated for resources: {'Port': ['ID=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:32.136133 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.137002 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.137347 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.137710 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.138040 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.138370 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.138717 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.139039 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.139362 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.139682 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.140006 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.140325 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:32.160102 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:32.160719 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:32.239985 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-3c9e63e4-0cfc-4155-b264-fb33447019cf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9140890 Nov 08 04:13:32.265201 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Request body: {'port': {'device_id': '81fe6aff-1d2b-4fb2-9774-590ad1d532f1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:13:32.319441 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:32.519196 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 52560) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:32.608774 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dc646599-8d18-41a0-9c3c-c4891c0f0c7c {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:13:32.622937 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:32.630837 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Transition to ACTIVE for port object dc646599-8d18-41a0-9c3c-c4891c0f0c7c will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:13:32.661403 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b6355265-9010-41fc-b8a6-ebaf9b4647ae admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:32.703174 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:32.792942 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Pushing event updated for resources: {'Port': ['ID=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:32.801156 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b6355265-9010-41fc-b8a6-ebaf9b4647ae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:32.839380 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 52572) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:32.864382 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Attempting to bind port dc646599-8d18-41a0-9c3c-c4891c0f0c7c on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:13:32.864947 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Attempting to bind port dc646599-8d18-41a0-9c3c-c4891c0f0c7c by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:13:32.865048 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Attempting to bind port dc646599-8d18-41a0-9c3c-c4891c0f0c7c on network 1516eeae-19de-448e-9ebd-952b54f99dcc {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:13:32.868212 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b6355265-9010-41fc-b8a6-ebaf9b4647ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:32.881847 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Port dc646599-8d18-41a0-9c3c-c4891c0f0c7c on network 1516eeae-19de-448e-9ebd-952b54f99dcc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:13:32.882082 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Attempting to bind port dc646599-8d18-41a0-9c3c-c4891c0f0c7c on network 1516eeae-19de-448e-9ebd-952b54f99dcc {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:13:32.904290 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 13, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:13:32.904630 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Checking segment: {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:13:32.905012 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Bound using segment: {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:13:32.905453 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Bound port: dc646599-8d18-41a0-9c3c-c4891c0f0c7c, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6af2a9a8-7c62-4511-940f-bdb70a610241', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 167, 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:13:32.905808 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:32.925204 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b6355265-9010-41fc-b8a6-ebaf9b4647ae admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=ca2bdccc0ea4427e9546aeaccbc5e1c7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4048607 Nov 08 04:13:32.925910 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6355265-9010-41fc-b8a6-ebaf9b4647ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37e78439-1ab5-43d2-92f8-9c4276a0a941,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:32.934510 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 52576) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:32.979124 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-44bb9472-d76e-48b6-8495-979e792e2376 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.008040 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.020491 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] For port dc646599-8d18-41a0-9c3c-c4891c0f0c7c, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:13:33.025177 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] For port dc646599-8d18-41a0-9c3c-c4891c0f0c7c, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:13:33.038587 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5ae545-e320-440d-96cc-ff921b42bb34 req-b4505bac-7203-4b01-97a8-ba5d02c8f744 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:33.038825 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.040166 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ef5ae545-e320-440d-96cc-ff921b42bb34 req-b4505bac-7203-4b01-97a8-ba5d02c8f744 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 944 time: 0.0751178 Nov 08 04:13:33.108408 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.124914 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-44bb9472-d76e-48b6-8495-979e792e2376 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.149497 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ef5ae545-e320-440d-96cc-ff921b42bb34 req-ec279c78-15ba-4ac5-865e-b838c2adf260 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1016238 Nov 08 04:13:33.159974 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.163275 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.175447 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/37e78439-1ab5-43d2-92f8-9c4276a0a941 HTTP/1.1" status: 204 len: 168 time: 0.2291327 Nov 08 04:13:33.176274 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a8a6bb-a9ce-4f01-a386-fccd2af0dac6 req-06da2802-c44a-42e5-9815-c788474d974d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:33.176274 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-14a8a6bb-a9ce-4f01-a386-fccd2af0dac6 req-06da2802-c44a-42e5-9815-c788474d974d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1129045 Nov 08 04:13:33.176603 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:33.177636 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.179415 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] 10.222.0.16 "PUT /v2.0/ports/dc646599-8d18-41a0-9c3c-c4891c0f0c7c HTTP/1.1" status: 200 len: 1094 time: 0.9202318 Nov 08 04:13:33.179937 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '81fe6aff-1d2b-4fb2-9774-590ad1d532f1', 'tag': 'dc646599-8d18-41a0-9c3c-c4891c0f0c7c'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:13:33.182299 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-80c24ef5-831c-43cc-b94b-2858aa658d82" -d '{"events": [{"name": "network-changed", "server_uuid": "81fe6aff-1d2b-4fb2-9774-590ad1d532f1", "tag": "dc646599-8d18-41a0-9c3c-c4891c0f0c7c"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:13:33.186963 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37e78439-1ab5-43d2-92f8-9c4276a0a941,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:33.202328 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-44bb9472-d76e-48b6-8495-979e792e2376 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.208084 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.208730 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.209408 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.210044 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.210860 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.211494 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.212486 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.213299 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.214001 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.216305 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.217039 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.217865 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396c21f9-8e94-471c-8f7a-c532998752f5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:33.241131 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9b52810-6da7-498c-9e62-24ae04c27e66 service neutron] Pushing event updated for resources: {'Port': ['ID=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:33.248298 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-14a8a6bb-a9ce-4f01-a386-fccd2af0dac6 req-e3b9452e-8f89-4139-9a5c-9e2b880770f2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584440 Nov 08 04:13:33.256926 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:13:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7435a4d-15c4-4933-8d6c-a8799df94fd0 x-openstack-request-id: req-e7435a4d-15c4-4933-8d6c-a8799df94fd0 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:13:33.260981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "81fe6aff-1d2b-4fb2-9774-590ad1d532f1", "tag": "dc646599-8d18-41a0-9c3c-c4891c0f0c7c", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:13:33.260981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-e7435a4d-15c4-4933-8d6c-a8799df94fd0 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:13:33.260981 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '81fe6aff-1d2b-4fb2-9774-590ad1d532f1', 'tag': 'dc646599-8d18-41a0-9c3c-c4891c0f0c7c', 'status': 'completed', 'code': 200} Nov 08 04:13:33.278206 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-44bb9472-d76e-48b6-8495-979e792e2376 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=7a2e318c90364357bf09e683970e7149&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4377105 Nov 08 04:13:33.279227 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44bb9472-d76e-48b6-8495-979e792e2376 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5a20777-f17c-47ef-9de2-cb9b0a37b39e,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:33.280921 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 52584) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:33.367710 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fd6ac4aa-3b99-4a7d-89e3-8f17777c017b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.392266 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fd6ac4aa-3b99-4a7d-89e3-8f17777c017b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.404532 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80c24ef5-831c-43cc-b94b-2858aa658d82 req-66f59fd6-c2a9-4d55-8f96-2d6be52e9c30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:33.405924 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80c24ef5-831c-43cc-b94b-2858aa658d82 req-66f59fd6-c2a9-4d55-8f96-2d6be52e9c30 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 1097 time: 0.0796349 Nov 08 04:13:33.526155 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80c24ef5-831c-43cc-b94b-2858aa658d82 req-0bea76bf-8757-40a6-a7ac-82c8a7e3548f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:33.528225 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80c24ef5-831c-43cc-b94b-2858aa658d82 req-0bea76bf-8757-40a6-a7ac-82c8a7e3548f service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1020987 Nov 08 04:13:33.566068 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fd6ac4aa-3b99-4a7d-89e3-8f17777c017b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.568445 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fd6ac4aa-3b99-4a7d-89e3-8f17777c017b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:33.572243 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-fd6ac4aa-3b99-4a7d-89e3-8f17777c017b admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/f5a20777-f17c-47ef-9de2-cb9b0a37b39e HTTP/1.1" status: 204 len: 168 time: 0.2876008 Nov 08 04:13:33.609315 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd6ac4aa-3b99-4a7d-89e3-8f17777c017b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5a20777-f17c-47ef-9de2-cb9b0a37b39e,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:33.654705 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80c24ef5-831c-43cc-b94b-2858aa658d82 req-a22827ac-a2e6-4380-b70c-d322ad050212 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:33.655423 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80c24ef5-831c-43cc-b94b-2858aa658d82 req-a22827ac-a2e6-4380-b70c-d322ad050212 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1197309 Nov 08 04:13:33.773028 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-bdada2c9-6f52-46ca-b27a-4e0bea842f65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:33.773411 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-bdada2c9-6f52-46ca-b27a-4e0bea842f65 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 1097 time: 0.0416512 Nov 08 04:13:33.839262 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-d36b403a-5467-4e62-90ff-496b644f7d59 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=dc646599-8d18-41a0-9c3c-c4891c0f0c7c HTTP/1.1" status: 200 len: 217 time: 0.0383921 Nov 08 04:13:33.894139 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-7e61dfcc-691d-4af3-b4bf-f54dcae9357a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:33.895623 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-7e61dfcc-691d-4af3-b4bf-f54dcae9357a service neutron] 10.222.0.16 "GET /v2.0/subnets?id=59ccbcae-2516-4cc7-9077-478845e3e1f2 HTTP/1.1" status: 200 len: 854 time: 0.0433152 Nov 08 04:13:33.929685 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-7d5b93a9-046e-4201-91b4-3cbf31633248 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=1516eeae-19de-448e-9ebd-952b54f99dcc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0250692 Nov 08 04:13:34.044515 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-ebe3811e-ec85-4a66-aad1-537dc0d023e2 service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0957341 Nov 08 04:13:34.192408 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-064b31cd-c1a4-4fe0-862a-1a48d646cbe9 req-b07379a9-0faf-4f0d-ba36-e29ca8c91fb6 service neutron] 10.222.0.16 "GET /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916474 Nov 08 04:13:34.278958 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4e6eeac-742c-4381-8b13-ac3717797783 req-54f60683-6507-410f-b27a-ef5ee6c42d1a tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:34.293415 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b4e6eeac-742c-4381-8b13-ac3717797783 req-54f60683-6507-410f-b27a-ef5ee6c42d1a tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 944 time: 0.0651190 Nov 08 04:13:34.321527 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 52622) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:34.346429 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c63145d-42e9-47d3-a0fd-d93458576261 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:34.377183 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b4e6eeac-742c-4381-8b13-ac3717797783 req-489f77d7-91fc-40bd-a182-a42251ddb789 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797734 Nov 08 04:13:34.397616 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e754b672-f193-454f-b46d-a33319a131f6 req-04cc345f-4d4a-430e-aeb5-0d2393b78dc6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:34.399261 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e754b672-f193-454f-b46d-a33319a131f6 req-04cc345f-4d4a-430e-aeb5-0d2393b78dc6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0645342 Nov 08 04:13:34.444121 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c63145d-42e9-47d3-a0fd-d93458576261 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:34.456507 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e754b672-f193-454f-b46d-a33319a131f6 req-bc2054e5-2822-47b3-8473-d43318fbed86 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512235 Nov 08 04:13:34.513213 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c63145d-42e9-47d3-a0fd-d93458576261 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:34.553795 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-2c63145d-42e9-47d3-a0fd-d93458576261 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=d261875da34c44d4bb2e6c36abe1ac39&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2287877 Nov 08 04:13:34.553795 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c63145d-42e9-47d3-a0fd-d93458576261 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e84aeceb-0cc9-4d3a-a04c-cbdd9ce5a44c,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:34.554545 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 52628) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:34.607754 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-efb485f5-8b34-4f97-9ced-9e1f452bc792 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:34.629003 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-efb485f5-8b34-4f97-9ced-9e1f452bc792 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:34.735920 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-efb485f5-8b34-4f97-9ced-9e1f452bc792 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:34.738475 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-efb485f5-8b34-4f97-9ced-9e1f452bc792 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:34.739630 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-efb485f5-8b34-4f97-9ced-9e1f452bc792 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/e84aeceb-0cc9-4d3a-a04c-cbdd9ce5a44c HTTP/1.1" status: 204 len: 168 time: 0.1835961 Nov 08 04:13:34.750187 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb485f5-8b34-4f97-9ced-9e1f452bc792 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e84aeceb-0cc9-4d3a-a04c-cbdd9ce5a44c,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:35.504422 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd2ca2f-b688-48b1-a209-a16b44196456 req-1510f8b9-8f49-4406-8bc3-ab4ee02c4677 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:35.510185 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ecd2ca2f-b688-48b1-a209-a16b44196456 req-1510f8b9-8f49-4406-8bc3-ab4ee02c4677 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 944 time: 0.0493340 Nov 08 04:13:35.590418 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0dcb850-7121-49fe-a6e0-5b48becc65dc req-cc3888b6-5119-4bb5-8103-e042ac34b4dd tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:35.591548 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a0dcb850-7121-49fe-a6e0-5b48becc65dc req-cc3888b6-5119-4bb5-8103-e042ac34b4dd tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0643592 Nov 08 04:13:35.595426 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ecd2ca2f-b688-48b1-a209-a16b44196456 req-e36fc7e8-6e4e-4516-84be-5fad30c30135 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828271 Nov 08 04:13:35.643537 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a0dcb850-7121-49fe-a6e0-5b48becc65dc req-5bbd2534-810b-49aa-931c-1db4f3d0bab7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455205 Nov 08 04:13:36.751761 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d381311-aa4b-4d9c-bd61-1eabc6c5e591 req-24c0b84b-7875-4a2f-b881-94acc34cc673 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:36.753250 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d381311-aa4b-4d9c-bd61-1eabc6c5e591 req-24c0b84b-7875-4a2f-b881-94acc34cc673 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 944 time: 0.0782502 Nov 08 04:13:36.793997 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fdc3ef0-0675-407c-a815-e1e7cd5c1cb4 req-d0670ed0-9a1b-42d9-add5-7ead6963cad1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:36.795565 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1fdc3ef0-0675-407c-a815-e1e7cd5c1cb4 req-d0670ed0-9a1b-42d9-add5-7ead6963cad1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0784700 Nov 08 04:13:36.833386 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d381311-aa4b-4d9c-bd61-1eabc6c5e591 req-a146a2b7-af78-427d-8230-958c4303a755 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734506 Nov 08 04:13:36.863017 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1fdc3ef0-0675-407c-a815-e1e7cd5c1cb4 req-02757111-1172-4ce3-9e14-7563c9ae505e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573251 Nov 08 04:13:37.317743 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ff8532-db99-4041-bebb-3adb3a08b852 req-c178659c-25ad-44e4-80d0-cca0b2329490 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:37.319380 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-41ff8532-db99-4041-bebb-3adb3a08b852 req-c178659c-25ad-44e4-80d0-cca0b2329490 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 1098 time: 0.0409803 Nov 08 04:13:37.371882 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-41ff8532-db99-4041-bebb-3adb3a08b852 req-6305d051-8b1d-4e66-b7ea-71fe03b086cf service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407009 Nov 08 04:13:37.691013 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 52738) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:37.794434 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a902637e-4fd9-4253-b9fe-a555a08acbe0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:37.869468 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a902637e-4fd9-4253-b9fe-a555a08acbe0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:37.907812 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a902637e-4fd9-4253-b9fe-a555a08acbe0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:37.949420 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a902637e-4fd9-4253-b9fe-a555a08acbe0 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=79b428dd7729499bab6c73b00fe3f134&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2549033 Nov 08 04:13:37.949420 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a902637e-4fd9-4253-b9fe-a555a08acbe0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1366a8bb-9ad1-46bc-8883-68e36b104994,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:37.951403 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 52746) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:37.987718 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e6b877-fb15-4f58-9784-3d8ebf130ac8 req-34bd7d70-d524-4203-af52-046690603fbd tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:37.989186 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-49e6b877-fb15-4f58-9784-3d8ebf130ac8 req-34bd7d70-d524-4203-af52-046690603fbd tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 944 time: 0.0836079 Nov 08 04:13:38.000681 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64f87156-67c1-4b2e-a192-e50c3e931ab7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:38.001238 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e258a2e9-e5c9-4b99-8c5b-0e93138a9a7b req-e27a6780-fec2-422d-b85d-a455634c5270 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:38.002689 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e258a2e9-e5c9-4b99-8c5b-0e93138a9a7b req-e27a6780-fec2-422d-b85d-a455634c5270 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0670266 Nov 08 04:13:38.017535 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device dc646599-8d18-41a0-9c3c-c4891c0f0c7c details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:13:38.023009 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64f87156-67c1-4b2e-a192-e50c3e931ab7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:38.078880 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-49e6b877-fb15-4f58-9784-3d8ebf130ac8 req-10eefb4e-e09a-4dee-acb5-a59f99e1b281 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752003 Nov 08 04:13:38.082357 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e258a2e9-e5c9-4b99-8c5b-0e93138a9a7b req-6b10370f-7845-495b-96dd-64bf30cb3b86 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728445 Nov 08 04:13:38.118811 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port dc646599-8d18-41a0-9c3c-c4891c0f0c7c, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:13:38.130168 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'dc646599-8d18-41a0-9c3c-c4891c0f0c7c', 'network_id': '1516eeae-19de-448e-9ebd-952b54f99dcc', 'port_id': 'dc646599-8d18-41a0-9c3c-c4891c0f0c7c', 'mac_address': 'fa:16:3e:a3:80:93', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59ccbcae-2516-4cc7-9077-478845e3e1f2', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:13:38.147448 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64f87156-67c1-4b2e-a192-e50c3e931ab7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:38.150727 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64f87156-67c1-4b2e-a192-e50c3e931ab7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:38.155524 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-64f87156-67c1-4b2e-a192-e50c3e931ab7 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/1366a8bb-9ad1-46bc-8883-68e36b104994 HTTP/1.1" status: 204 len: 168 time: 0.2007012 Nov 08 04:13:38.165955 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f87156-67c1-4b2e-a192-e50c3e931ab7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1366a8bb-9ad1-46bc-8883-68e36b104994,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:38.170585 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:38.194074 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dc646599-8d18-41a0-9c3c-c4891c0f0c7c {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:13:38.219911 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port dc646599-8d18-41a0-9c3c-c4891c0f0c7c, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:13:38.272792 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:38.319916 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:38.327389 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.327747 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.328086 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.328410 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.328731 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.329052 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.329374 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.329689 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.330006 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.330322 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.330669 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:38.330983 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:13:39.070582 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['dc646599-8d18-41a0-9c3c-c4891c0f0c7c'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:13:39.263588 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70fd95e9-59e8-4fd2-90c6-e38076ca90b7 req-a47241de-3924-4417-9619-a6a5e2b9e1b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:39.271302 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-70fd95e9-59e8-4fd2-90c6-e38076ca90b7 req-a47241de-3924-4417-9619-a6a5e2b9e1b1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1091015 Nov 08 04:13:39.290264 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dd25560-05e8-4abb-9823-f07dfef1289d req-0b4f2646-1de8-484e-8d94-dbc587731890 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:39.298043 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dd25560-05e8-4abb-9823-f07dfef1289d req-0b4f2646-1de8-484e-8d94-dbc587731890 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 945 time: 0.1243365 Nov 08 04:13:39.363161 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-70fd95e9-59e8-4fd2-90c6-e38076ca90b7 req-303eb7f4-3072-4fa2-a2d1-63c3ffdfa0b0 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908253 Nov 08 04:13:39.380610 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dd25560-05e8-4abb-9823-f07dfef1289d req-c22a7668-a1c8-4a8b-b75f-77c72314df4f tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773005 Nov 08 04:13:40.508440 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d632133-a935-48e2-b95f-f7612c934d22 req-b040bd13-ce69-49fc-9663-ac63dd6b805c tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:40.509882 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d632133-a935-48e2-b95f-f7612c934d22 req-b040bd13-ce69-49fc-9663-ac63dd6b805c tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0815990 Nov 08 04:13:40.521246 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06a7fb24-1d68-4d9e-8d90-ed65bf71adc9 req-9e1db3cf-ec08-4fde-a577-73b5512948f5 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:40.522696 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06a7fb24-1d68-4d9e-8d90-ed65bf71adc9 req-9e1db3cf-ec08-4fde-a577-73b5512948f5 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 945 time: 0.0676770 Nov 08 04:13:40.589625 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d632133-a935-48e2-b95f-f7612c934d22 req-a7d94443-22c1-4947-af61-eb03a197b10a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660534 Nov 08 04:13:40.596875 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06a7fb24-1d68-4d9e-8d90-ed65bf71adc9 req-596c6683-3256-4de5-9256-85e0773e64b5 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676420 Nov 08 04:13:40.992965 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c29793e-7b87-4d5c-a195-666fb0a72e3b req-fec92b1e-b5bb-4d45-9059-795e3d8980f2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:40.994397 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c29793e-7b87-4d5c-a195-666fb0a72e3b req-fec92b1e-b5bb-4d45-9059-795e3d8980f2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0471704 Nov 08 04:13:41.045746 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c29793e-7b87-4d5c-a195-666fb0a72e3b req-73eda00a-4835-4362-9e63-3847f816bc1d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440228 Nov 08 04:13:41.132535 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6123168-0582-4460-b38c-6bf032f37bee req-7e29f917-c022-41b7-ba57-1f09d94b6c26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:41.133778 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6123168-0582-4460-b38c-6bf032f37bee req-7e29f917-c022-41b7-ba57-1f09d94b6c26 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 1098 time: 0.0410037 Nov 08 04:13:41.228626 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-a52cd72e-4354-4dab-bd7f-6119de94635b tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/networks?tenant_id=a5f11ad5c7cb47a294236806767980a4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0359485 Nov 08 04:13:41.341564 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6123168-0582-4460-b38c-6bf032f37bee req-5fe55f46-d92f-4f21-ac46-a7e1bbb9a30a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:41.343038 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6123168-0582-4460-b38c-6bf032f37bee req-5fe55f46-d92f-4f21-ac46-a7e1bbb9a30a service neutron] 10.222.0.16 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 920 time: 0.2010388 Nov 08 04:13:41.418456 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6123168-0582-4460-b38c-6bf032f37bee req-b4fa0564-4062-4ee1-a0d9-f84d27fb0f80 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000 HTTP/1.1" status: 200 len: 217 time: 0.0533237 Nov 08 04:13:41.485109 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875288e6-8003-4856-a834-5474e177dfa5 req-869140c2-c23f-43cd-b17d-7884b77878fb tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:41.486555 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-869140c2-c23f-43cd-b17d-7884b77878fb tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2515903 Nov 08 04:13:41.506297 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-9ad5cda9-e24f-449d-b25e-8b18fccc8b9f tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/quotas/a5f11ad5c7cb47a294236806767980a4 HTTP/1.1" status: 200 len: 375 time: 0.0135350 Nov 08 04:13:41.507744 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6123168-0582-4460-b38c-6bf032f37bee req-2c90dda1-f1db-40de-bab1-cfb1b854d2eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:41.509052 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6123168-0582-4460-b38c-6bf032f37bee req-2c90dda1-f1db-40de-bab1-cfb1b854d2eb service neutron] 10.222.0.16 "GET /v2.0/subnets?id=900a12a5-1baa-47e1-8b64-245dc70bc9f2 HTTP/1.1" status: 200 len: 859 time: 0.0782328 Nov 08 04:13:41.536316 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-0bde57f0-df14-4815-9cec-d7b6109c2028 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=a5f11ad5c7cb47a294236806767980a4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0239305 Nov 08 04:13:41.588589 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6123168-0582-4460-b38c-6bf032f37bee req-6aa9a486-8738-4e8b-bb38-d08f4d223d72 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0256610 Nov 08 04:13:41.691015 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6123168-0582-4460-b38c-6bf032f37bee req-275fe693-f513-46f2-8296-190148699469 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0958080 Nov 08 04:13:41.789483 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da912e53-07bd-4889-8462-af414ba44b75 req-f673d6d2-3f2f-47d3-9398-c0168f5c6e9e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:41.790792 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-da912e53-07bd-4889-8462-af414ba44b75 req-f673d6d2-3f2f-47d3-9398-c0168f5c6e9e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 945 time: 0.1210730 Nov 08 04:13:42.014153 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d49e8128-04e6-4e4b-8602-e84379dbb70f req-80f7969b-3deb-43db-bed8-9aa82a8e7f3b tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 210 time: 0.2476640 Nov 08 04:13:42.040639 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device dc646599-8d18-41a0-9c3c-c4891c0f0c7c up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:13:42.062355 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6123168-0582-4460-b38c-6bf032f37bee req-6307700d-d573-41ea-9059-2f7021508041 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3545928 Nov 08 04:13:42.076202 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-da912e53-07bd-4889-8462-af414ba44b75 req-0b4c39f4-ef3f-4954-b3e4-ec374da2e42b tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579627 Nov 08 04:13:42.164433 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port dc646599-8d18-41a0-9c3c-c4891c0f0c7c completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:13:42.169241 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port dc646599-8d18-41a0-9c3c-c4891c0f0c7c triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:13:42.169608 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:42.180766 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ce1f2b3-dcda-4d6e-a627-0812535a8900 req-6f9e72b7-0145-4da7-b645-56c39e8df2c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:42.182246 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ce1f2b3-dcda-4d6e-a627-0812535a8900 req-6f9e72b7-0145-4da7-b645-56c39e8df2c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0606177 Nov 08 04:13:42.256111 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:42.270808 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ce1f2b3-dcda-4d6e-a627-0812535a8900 req-6a5c4792-45df-4617-95c0-88dd5e5948c2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0815296 Nov 08 04:13:42.291821 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '81fe6aff-1d2b-4fb2-9774-590ad1d532f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dc646599-8d18-41a0-9c3c-c4891c0f0c7c'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:13:42.294888 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c64f4de9-4a04-4ccb-9e49-383781dd2178" -d '{"events": [{"server_uuid": "81fe6aff-1d2b-4fb2-9774-590ad1d532f1", "name": "network-vif-plugged", "status": "completed", "tag": "dc646599-8d18-41a0-9c3c-c4891c0f0c7c"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:13:42.307161 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port dc646599-8d18-41a0-9c3c-c4891c0f0c7c, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:13:42.331285 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:13:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09d95e8d-51be-4a32-99a0-00d358df1adc x-openstack-request-id: req-09d95e8d-51be-4a32-99a0-00d358df1adc {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:13:42.331595 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "81fe6aff-1d2b-4fb2-9774-590ad1d532f1", "name": "network-vif-plugged", "status": "completed", "tag": "dc646599-8d18-41a0-9c3c-c4891c0f0c7c", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:13:42.331850 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-09d95e8d-51be-4a32-99a0-00d358df1adc {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:13:42.332239 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '81fe6aff-1d2b-4fb2-9774-590ad1d532f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dc646599-8d18-41a0-9c3c-c4891c0f0c7c', 'code': 200} Nov 08 04:13:42.369674 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:42.416926 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:42.672782 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-27f87908-aa04-4988-a7ae-7825493fc2c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:42.802665 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592d1b6c-695c-4385-a8f0-2ed56f31157c req-0e758209-3f94-45ed-b015-0b279144410e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:42.804158 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-592d1b6c-695c-4385-a8f0-2ed56f31157c req-0e758209-3f94-45ed-b015-0b279144410e service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 1099 time: 0.0393181 Nov 08 04:13:42.857470 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-592d1b6c-695c-4385-a8f0-2ed56f31157c req-26893531-4edf-4c63-a083-8ab4d6d6e809 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414186 Nov 08 04:13:43.105605 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea6c9e9a-7af7-477e-b348-760706f075fd req-dc5da3c2-0338-4a46-a877-2fc078e83e31 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 210 time: 0.0246804 Nov 08 04:13:43.192091 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731756a0-bdf7-4ce8-ac1c-75c81b6f8e5e req-9b078ed7-11b1-4853-8d31-fa01f11001d4 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:43.193517 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-731756a0-bdf7-4ce8-ac1c-75c81b6f8e5e req-9b078ed7-11b1-4853-8d31-fa01f11001d4 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 946 time: 0.0460496 Nov 08 04:13:43.238971 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-731756a0-bdf7-4ce8-ac1c-75c81b6f8e5e req-d1b0ffb5-9ba3-4882-a66c-8ac7228bfcaf tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391088 Nov 08 04:13:43.394182 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab8ba783-220d-4520-a273-de7edd002004 req-076fc045-9919-459d-8603-9fa0c93169a2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:43.395770 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ab8ba783-220d-4520-a273-de7edd002004 req-076fc045-9919-459d-8603-9fa0c93169a2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0510945 Nov 08 04:13:43.397961 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 52894) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:43.448801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ab8ba783-220d-4520-a273-de7edd002004 req-885c8e9e-dd51-4ab3-b966-c3d6e3d398f2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450261 Nov 08 04:13:43.501162 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-635bc779-bcd8-47d1-bfd6-a1b775ef31a9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:43.573309 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-635bc779-bcd8-47d1-bfd6-a1b775ef31a9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:43.727697 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-635bc779-bcd8-47d1-bfd6-a1b775ef31a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:43.769355 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-635bc779-bcd8-47d1-bfd6-a1b775ef31a9 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=522d835999b940a48fe5773158303092&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3681033 Nov 08 04:13:43.769355 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-635bc779-bcd8-47d1-bfd6-a1b775ef31a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00e9ec2a-13c9-40e6-9e16-11a1edc427b2,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:43.770017 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 52904) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:43.832685 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-314dffed-bbf2-49f1-9433-214b30ba1c7d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:43.856391 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-314dffed-bbf2-49f1-9433-214b30ba1c7d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:43.975696 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-314dffed-bbf2-49f1-9433-214b30ba1c7d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:43.978260 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-314dffed-bbf2-49f1-9433-214b30ba1c7d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:43.979428 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-314dffed-bbf2-49f1-9433-214b30ba1c7d admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/00e9ec2a-13c9-40e6-9e16-11a1edc427b2 HTTP/1.1" status: 204 len: 168 time: 0.2082758 Nov 08 04:13:43.987675 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-314dffed-bbf2-49f1-9433-214b30ba1c7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00e9ec2a-13c9-40e6-9e16-11a1edc427b2,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:44.210071 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85f1ef11-64f5-4ce8-8d4e-675933dafece req-c02b6faa-dfda-42d3-b866-be97432df798 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 210 time: 0.0275264 Nov 08 04:13:44.366115 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2d79005-76bc-465c-8062-46837f773e40 req-8b517170-e61f-46da-ba76-36fc12f483c9 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:44.367681 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c2d79005-76bc-465c-8062-46837f773e40 req-8b517170-e61f-46da-ba76-36fc12f483c9 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 946 time: 0.0513303 Nov 08 04:13:44.425315 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c2d79005-76bc-465c-8062-46837f773e40 req-fe32f3c5-16a0-4011-a6e3-7ebeacc3776f tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442624 Nov 08 04:13:44.582721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80face1a-752b-46e6-a4ec-be5afa21c693 req-18815a18-cb0d-4d34-8ffa-6754b1c792fb tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:44.586221 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80face1a-752b-46e6-a4ec-be5afa21c693 req-18815a18-cb0d-4d34-8ffa-6754b1c792fb tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0566902 Nov 08 04:13:44.641899 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80face1a-752b-46e6-a4ec-be5afa21c693 req-d884be37-332a-4f56-b317-750edbc4cba6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459900 Nov 08 04:13:44.679697 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 52922) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:44.693021 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6b5ac846-b1a4-4799-b765-d728f37bb607 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:44.772040 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6b5ac846-b1a4-4799-b765-d728f37bb607 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:44.836449 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6b5ac846-b1a4-4799-b765-d728f37bb607 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:44.874347 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-6b5ac846-b1a4-4799-b765-d728f37bb607 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=e2e24a208c714333b4c4939d391359a9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1934674 Nov 08 04:13:44.876368 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5ac846-b1a4-4799-b765-d728f37bb607 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70fefefd-aeeb-4083-8e6c-55e636017d62,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:44.877048 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 52924) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:44.928687 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9289ee53-0c0e-4c4f-bfdb-8707b95baf97 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:44.950118 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9289ee53-0c0e-4c4f-bfdb-8707b95baf97 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:45.065831 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9289ee53-0c0e-4c4f-bfdb-8707b95baf97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:45.068444 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9289ee53-0c0e-4c4f-bfdb-8707b95baf97 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:45.069494 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-9289ee53-0c0e-4c4f-bfdb-8707b95baf97 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/70fefefd-aeeb-4083-8e6c-55e636017d62 HTTP/1.1" status: 204 len: 168 time: 0.1914878 Nov 08 04:13:45.082513 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-0afa4e3d-203c-484f-a4da-e1250735c63c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.16 "GET /v2.0/networks?tenant_id=a5f11ad5c7cb47a294236806767980a4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0282032 Nov 08 04:13:45.087788 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9289ee53-0c0e-4c4f-bfdb-8707b95baf97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70fefefd-aeeb-4083-8e6c-55e636017d62,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:45.168938 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-81d153f7-29e3-4a50-80fe-59f06532b81d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:45.257492 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875288e6-8003-4856-a834-5474e177dfa5 req-b28643ea-bfc1-4ac3-bdd5-33b6d6aba950 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:45.257492 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-b28643ea-bfc1-4ac3-bdd5-33b6d6aba950 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1095898 Nov 08 04:13:45.293401 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Request body: {'port': {'device_id': 'd45d2fc6-0c61-4a25-8469-0f73c32f86cb', 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2', 'admin_state_up': True, 'tenant_id': 'a5f11ad5c7cb47a294236806767980a4'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:13:45.336280 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0fcac433-6760-46cf-bcfb-611f23c389db req-711ffcaa-c49a-4427-adc7-9e809f0e2369 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 210 time: 0.0391643 Nov 08 04:13:45.496084 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Made reservation on behalf of a5f11ad5c7cb47a294236806767980a4 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:13:45.500128 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:45.522452 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:45.578666 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5142c114-0247-4d5d-acd2-e664c1ce3b0e req-d041d68e-5c3f-424e-802c-58216fee94ca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:45.580187 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5142c114-0247-4d5d-acd2-e664c1ce3b0e req-d041d68e-5c3f-424e-802c-58216fee94ca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 946 time: 0.0770509 Nov 08 04:13:45.655707 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5142c114-0247-4d5d-acd2-e664c1ce3b0e req-0cc686b0-d3e0-4813-abce-20b4e24bec68 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686846 Nov 08 04:13:45.659976 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:45.744355 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:45.821539 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3d16541d-cc40-4a8f-82cf-721d12a7d90c,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:45.834605 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-483b501a-4497-486d-8574-f6f23ca636bd req-59db2dbe-319d-4db7-bc11-19a0525bb786 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:45.836162 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-483b501a-4497-486d-8574-f6f23ca636bd req-59db2dbe-319d-4db7-bc11-19a0525bb786 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1245062 Nov 08 04:13:45.930176 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-483b501a-4497-486d-8574-f6f23ca636bd req-cea93e13-a2bd-45cd-ac41-df3da70eb9b5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847850 Nov 08 04:13:45.940812 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Allocated IP 192.168.233.196 (18db37fe-c823-44c7-b9ff-932f31016ab2/b3499532-a30e-4b90-986b-3792010a47fb/f674fc7c-fe02-4d8c-9856-490782668990) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:13:45.990834 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.083889 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.146235 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 52962) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:46.186035 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.231543 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Network 18db37fe-c823-44c7-b9ff-932f31016ab2 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:13:46.235602 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:13:46.238941 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:13:46.253182 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-353723367-network', 'tenant_id': 'edc63d7a2a744b17a120c4d21149a2d0'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:13:46.288310 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Pushing event updated for resources: {'Port': ['ID=f674fc7c-fe02-4d8c-9856-490782668990,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:46.314895 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:46.315512 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.399703 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Made reservation on behalf of edc63d7a2a744b17a120c4d21149a2d0 for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:13:46.402305 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.411735 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.486522 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.510294 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-b64aafb3-65e0-473d-87e8-9767ea665f34 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.2221467 Nov 08 04:13:46.530378 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-cc5e375e-a916-46f1-beed-d46256ddd37f None None] Provisioning complete for port f674fc7c-fe02-4d8c-9856-490782668990 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:13:46.530913 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cc5e375e-a916-46f1-beed-d46256ddd37f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.563798 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-cc5e375e-a916-46f1-beed-d46256ddd37f None None] Port f674fc7c-fe02-4d8c-9856-490782668990 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:13:46.569752 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.591766 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] vlan segment allocate from pool success with {'vlan_id': 173, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:13:46.605642 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e01fc88-1e6e-4e50-bc53-6c52498c7510,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:46.610466 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.610830 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Added segment 352fab34-f426-4ea6-a0d5-2c5b84c3f901 of type vlan for network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 Nov 08 04:13:46.648931 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.741051 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.742012 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:46.742627 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:46.803452 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] Pushing event updated for resources: {'Network': ['ID=a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:46.812824 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:13:46.859334 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-725357fb-9046-427a-ab66-1f2377c2e6c9 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.7118816 Nov 08 04:13:46.862442 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 52976) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:13:46.869982 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Request body: {'subnet': {'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-353723367-subnet', 'tenant_id': 'edc63d7a2a744b17a120c4d21149a2d0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:13:46.946821 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Made reservation on behalf of edc63d7a2a744b17a120c4d21149a2d0 for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:13:46.949176 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5043309'] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:47.156327 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5120956', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5043607'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:47.209039 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Pushing event updated for resources: {'Subnet': ['ID=8fce9f14-c9c6-47d9-9ea8-c6a5dedd5ca7,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:47.217956 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Checking segment: {'id': '352fab34-f426-4ea6-a0d5-2c5b84c3f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:13:47.218310 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Network hostable DHCP agents. Network: a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:13:47.320189 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:13:47.404053 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:13:47.408410 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:47.408966 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:47.412892 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78334f23-ea6d-480d-9ba7-53700f0df0b7 None None] Network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:13:47.481375 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-4e9957c1-a543-4aa4-ac0f-ca2d94512fdc admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6177850 Nov 08 04:13:47.542951 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-974a4aca-26bf-4acc-8013-3a1af912cd66 None None] Network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:13:47.611643 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:48.375941 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:48.389617 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Request body: {'port': {'device_id': 'd45d2fc6-0c61-4a25-8469-0f73c32f86cb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:13:48.443667 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:48.659233 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e7d0b2-cfbf-469d-b677-9cd913007b86 req-a5a6cbc9-bbf6-410e-8e01-4cb0e165ccd9 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:48.660707 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-52e7d0b2-cfbf-469d-b677-9cd913007b86 req-a5a6cbc9-bbf6-410e-8e01-4cb0e165ccd9 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 936 time: 0.1620839 Nov 08 04:13:48.722245 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38435099-1c07-4f38-932f-cf18370fbddf req-b5cc95a6-ecb3-41d5-818d-660eb3c7ae37 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:48.723711 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-38435099-1c07-4f38-932f-cf18370fbddf req-b5cc95a6-ecb3-41d5-818d-660eb3c7ae37 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1395693 Nov 08 04:13:48.797033 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-52e7d0b2-cfbf-469d-b677-9cd913007b86 req-c56e17f5-fcd5-4bcc-9c36-7e64fab7782f tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1263371 Nov 08 04:13:48.826732 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-38435099-1c07-4f38-932f-cf18370fbddf req-4da7f384-825f-49f1-a909-0c276ed8a985 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0926480 Nov 08 04:13:48.892572 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f674fc7c-fe02-4d8c-9856-490782668990 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:13:48.904233 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:48.917682 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Transition to ACTIVE for port object f674fc7c-fe02-4d8c-9856-490782668990 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:13:48.972989 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:49.022294 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Pushing event updated for resources: {'Port': ['ID=f674fc7c-fe02-4d8c-9856-490782668990,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:49.089250 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Attempting to bind port f674fc7c-fe02-4d8c-9856-490782668990 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:13:49.089587 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Attempting to bind port f674fc7c-fe02-4d8c-9856-490782668990 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': 'cc10be93-0a6f-4015-8f02-6e9e8ff3abed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:13:49.094773 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Attempting to bind port f674fc7c-fe02-4d8c-9856-490782668990 on network 18db37fe-c823-44c7-b9ff-932f31016ab2 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:13:49.094935 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Port f674fc7c-fe02-4d8c-9856-490782668990 on network 18db37fe-c823-44c7-b9ff-932f31016ab2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:13:49.095335 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Attempting to bind port f674fc7c-fe02-4d8c-9856-490782668990 on network 18db37fe-c823-44c7-b9ff-932f31016ab2 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:13:49.100298 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 13, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:13:49.100639 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Checking segment: {'id': 'cc10be93-0a6f-4015-8f02-6e9e8ff3abed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:13:49.101021 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Bound using segment: {'id': 'cc10be93-0a6f-4015-8f02-6e9e8ff3abed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:13:49.101454 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Bound port: f674fc7c-fe02-4d8c-9856-490782668990, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cc10be93-0a6f-4015-8f02-6e9e8ff3abed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 164, 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:13:49.101806 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:49.170080 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] For port f674fc7c-fe02-4d8c-9856-490782668990, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:13:49.173101 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] For port f674fc7c-fe02-4d8c-9856-490782668990, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=f674fc7c-fe02-4d8c-9856-490782668990,segment=NetworkSegment(cc10be93-0a6f-4015-8f02-6e9e8ff3abed),segment_id=cc10be93-0a6f-4015-8f02-6e9e8ff3abed)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:13:49.233471 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:49.266388 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:49.272411 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:49.272411 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] 10.222.0.16 "PUT /v2.0/ports/f674fc7c-fe02-4d8c-9856-490782668990 HTTP/1.1" status: 200 len: 1098 time: 0.8831758 Nov 08 04:13:49.272411 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd45d2fc6-0c61-4a25-8469-0f73c32f86cb', 'tag': 'f674fc7c-fe02-4d8c-9856-490782668990'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:13:49.272411 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fccb6257-7bcd-46f4-9f6e-84cfa6572abb" -d '{"events": [{"name": "network-changed", "server_uuid": "d45d2fc6-0c61-4a25-8469-0f73c32f86cb", "tag": "f674fc7c-fe02-4d8c-9856-490782668990"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:13:49.302151 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b8af4aa-9599-4e85-a607-20888b11679d service neutron] Pushing event updated for resources: {'Port': ['ID=f674fc7c-fe02-4d8c-9856-490782668990,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:49.317966 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:13:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8134d73d-bd6c-4957-9c01-48d70707417a x-openstack-request-id: req-8134d73d-bd6c-4957-9c01-48d70707417a {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:13:49.318459 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d45d2fc6-0c61-4a25-8469-0f73c32f86cb", "tag": "f674fc7c-fe02-4d8c-9856-490782668990", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:13:49.318766 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-8134d73d-bd6c-4957-9c01-48d70707417a {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:13:49.319166 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd45d2fc6-0c61-4a25-8469-0f73c32f86cb', 'tag': 'f674fc7c-fe02-4d8c-9856-490782668990', 'status': 'completed', 'code': 200} Nov 08 04:13:49.455786 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fccb6257-7bcd-46f4-9f6e-84cfa6572abb req-eef89113-56c8-4735-8ab4-0768ec55675b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:49.457291 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fccb6257-7bcd-46f4-9f6e-84cfa6572abb req-eef89113-56c8-4735-8ab4-0768ec55675b service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a5f11ad5c7cb47a294236806767980a4&device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 1101 time: 0.0552638 Nov 08 04:13:49.506029 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fccb6257-7bcd-46f4-9f6e-84cfa6572abb req-c10c2aa4-6ab3-49a4-968b-0fc7f13c8cda service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=a5f11ad5c7cb47a294236806767980a4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0271127 Nov 08 04:13:49.649257 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fccb6257-7bcd-46f4-9f6e-84cfa6572abb req-3252352f-9818-446d-8993-f6f3edf34ae9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:49.649257 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fccb6257-7bcd-46f4-9f6e-84cfa6572abb req-3252352f-9818-446d-8993-f6f3edf34ae9 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0939264 Nov 08 04:13:49.790523 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875288e6-8003-4856-a834-5474e177dfa5 req-9cc48321-a2b9-4508-9262-d14f1a283014 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:49.791976 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-9cc48321-a2b9-4508-9262-d14f1a283014 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=a5f11ad5c7cb47a294236806767980a4&device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 1101 time: 0.0413930 Nov 08 04:13:49.891685 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-5f803f34-7f2c-4916-b9c1-1dac3ed4798b service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.196&port_id=f674fc7c-fe02-4d8c-9856-490782668990 HTTP/1.1" status: 200 len: 217 time: 0.0491991 Nov 08 04:13:49.969661 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-865e2da9-4494-4cd7-968e-03fd885d4233 req-d974ee69-de0c-4996-89e4-f90c19aab522 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:49.971139 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:13:49.971638 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-865e2da9-4494-4cd7-968e-03fd885d4233 req-d974ee69-de0c-4996-89e4-f90c19aab522 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 948 time: 0.0820255 Nov 08 04:13:49.972983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875288e6-8003-4856-a834-5474e177dfa5 req-07fcf96a-dab5-42c8-8d34-d3abc856f53a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:49.974269 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-07fcf96a-dab5-42c8-8d34-d3abc856f53a service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b3499532-a30e-4b90-986b-3792010a47fb HTTP/1.1" status: 200 len: 843 time: 0.0603130 Nov 08 04:13:50.052305 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-865e2da9-4494-4cd7-968e-03fd885d4233 req-7ff9441e-deaa-4dca-80c1-81710ce9676b tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739398 Nov 08 04:13:50.055002 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875288e6-8003-4856-a834-5474e177dfa5 req-9ce4b121-515b-4f19-a7a5-323ea965d4c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:50.056386 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-9ce4b121-515b-4f19-a7a5-323ea965d4c5 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=18db37fe-c823-44c7-b9ff-932f31016ab2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0644770 Nov 08 04:13:50.192560 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-ab774f78-b351-46a5-ba18-ba1a49f3a5d4 service neutron] 10.222.0.16 "GET /v2.0/networks/18db37fe-c823-44c7-b9ff-932f31016ab2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1184566 Nov 08 04:13:50.200341 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f8960ed-5c8a-4389-87c0-996fd005dec0 req-3e1c3491-c66f-44c5-9a5a-5a56a44bd6a2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:50.201660 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8f8960ed-5c8a-4389-87c0-996fd005dec0 req-3e1c3491-c66f-44c5-9a5a-5a56a44bd6a2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0736909 Nov 08 04:13:50.302643 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8f8960ed-5c8a-4389-87c0-996fd005dec0 req-0d9dc1d1-f8d7-4772-bdc2-88d92bccd56b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0829699 Nov 08 04:13:50.320141 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-875288e6-8003-4856-a834-5474e177dfa5 req-4c7efd57-e068-46e0-9066-99b87d295352 service neutron] 10.222.0.16 "GET /v2.0/networks/18db37fe-c823-44c7-b9ff-932f31016ab2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1134799 Nov 08 04:13:50.836765 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-74c2f88b-77aa-4b81-90f3-a64079e83d13 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:50.838253 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-74c2f88b-77aa-4b81-90f3-a64079e83d13 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/networks?id=a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 HTTP/1.1" status: 200 len: 808 time: 0.1084502 Nov 08 04:13:50.855964 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-db69ddd7-2d08-4ba6-b920-8aaddd655608 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/quotas/edc63d7a2a744b17a120c4d21149a2d0 HTTP/1.1" status: 200 len: 375 time: 0.0104518 Nov 08 04:13:50.890094 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-73f9a887-e50e-4a33-a320-02a4014535af tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=edc63d7a2a744b17a120c4d21149a2d0&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0271790 Nov 08 04:13:50.981712 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-7c74d9f1-7482-49af-aab0-f5c02b3a0b7e service neutron] 10.222.0.21 "GET /v2.0/networks/a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843704 Nov 08 04:13:51.069817 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-2257a06e-7b89-4cf1-ab9d-b0e6cdc2672f service neutron] 10.222.0.21 "GET /v2.0/networks/a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817416 Nov 08 04:13:51.171937 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c83ca68-22c5-4b55-91cd-d27fe64cc9ed req-5aee2bdb-3ba0-4fa5-a418-84db550743d0 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:51.173405 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c83ca68-22c5-4b55-91cd-d27fe64cc9ed req-5aee2bdb-3ba0-4fa5-a418-84db550743d0 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 948 time: 0.0510228 Nov 08 04:13:51.219462 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c83ca68-22c5-4b55-91cd-d27fe64cc9ed req-b6e451e3-8149-4a3c-8496-7c23342c8f45 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398023 Nov 08 04:13:51.338514 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-889c7245-a506-4369-a4a0-ea020da040f8 req-57ea9295-3bc6-4c76-ab35-6fcfe912f75f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 210 time: 0.0252032 Nov 08 04:13:52.063121 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b61f85ec-a3f8-482f-956f-61fb665e642f req-2e04b576-5d6e-4239-9e1c-7b51d5e5e9fa tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:52.064608 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b61f85ec-a3f8-482f-956f-61fb665e642f req-2e04b576-5d6e-4239-9e1c-7b51d5e5e9fa tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0579467 Nov 08 04:13:52.111493 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b61f85ec-a3f8-482f-956f-61fb665e642f req-c4ecb4fe-c9c3-4d16-95e5-bdd59856839b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410023 Nov 08 04:13:52.338882 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b494d80d-f047-4d77-973c-c554210e641d req-d2b18a8d-521b-4289-bcee-3021bac90b42 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:52.340962 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b494d80d-f047-4d77-973c-c554210e641d req-d2b18a8d-521b-4289-bcee-3021bac90b42 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 948 time: 0.0515583 Nov 08 04:13:52.392120 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b494d80d-f047-4d77-973c-c554210e641d req-91742524-1a12-4561-abb4-f4243c41cba5 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448840 Nov 08 04:13:52.471565 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-134a07a5-f3ea-410c-82dd-5ea03e048651 req-f839c5e5-1642-4bcd-b0dd-d79aa8a45ace tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 210 time: 0.0252180 Nov 08 04:13:53.508301 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc1db975-7360-4572-863e-90e7aa29dd6d req-83b3fede-e80a-45ad-a1d7-3e2504e92e73 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:53.510002 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dc1db975-7360-4572-863e-90e7aa29dd6d req-83b3fede-e80a-45ad-a1d7-3e2504e92e73 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 948 time: 0.0501406 Nov 08 04:13:53.590472 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-45625c03-d4b6-4a26-9795-5f84310eb8cd req-81b99215-7911-4966-9756-560f3aefb2cd tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 210 time: 0.0416551 Nov 08 04:13:53.595082 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dc1db975-7360-4572-863e-90e7aa29dd6d req-0b58c5a5-fb3e-4edc-b2b9-d65986f96238 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679672 Nov 08 04:13:53.848851 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-1c4b55d3-aeeb-406a-9e2c-7882db476102 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:53.850183 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-1c4b55d3-aeeb-406a-9e2c-7882db476102 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.16 "GET /v2.0/networks?id=a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 HTTP/1.1" status: 200 len: 808 time: 0.0996923 Nov 08 04:13:53.879195 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Request body: {'port': {'device_id': 'f3bac963-8704-4c45-bf9e-2320463cb1f8', 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7', 'admin_state_up': True, 'tenant_id': 'edc63d7a2a744b17a120c4d21149a2d0'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:13:54.067160 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Made reservation on behalf of edc63d7a2a744b17a120c4d21149a2d0 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:13:54.072248 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:54.150872 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:54.197648 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Allocated IP 172.20.0.12 (a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7/8fce9f14-c9c6-47d9-9ea8-c6a5dedd5ca7/d84312ee-38b9-4f5e-bf0a-91096cbbfd1c) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:13:54.301478 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device f674fc7c-fe02-4d8c-9856-490782668990 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:13:54.358816 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:54.418931 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port f674fc7c-fe02-4d8c-9856-490782668990, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=f674fc7c-fe02-4d8c-9856-490782668990,segment=NetworkSegment(cc10be93-0a6f-4015-8f02-6e9e8ff3abed),segment_id=cc10be93-0a6f-4015-8f02-6e9e8ff3abed)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:13:54.473927 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:54.525065 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:13:54.529696 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:13:54.531645 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Pushing event updated for resources: {'Port': ['ID=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:54.533797 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:13:54.548887 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'f674fc7c-fe02-4d8c-9856-490782668990', 'network_id': '18db37fe-c823-44c7-b9ff-932f31016ab2', 'port_id': 'f674fc7c-fe02-4d8c-9856-490782668990', 'mac_address': 'fa:16:3e:28:6e:e7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 164, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b3499532-a30e-4b90-986b-3792010a47fb', 'ip_address': '192.168.233.196'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:13:54.588434 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:54.589089 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:54.592292 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:54.606274 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f674fc7c-fe02-4d8c-9856-490782668990 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:13:54.632267 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port f674fc7c-fe02-4d8c-9856-490782668990, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=f674fc7c-fe02-4d8c-9856-490782668990,segment=NetworkSegment(cc10be93-0a6f-4015-8f02-6e9e8ff3abed),segment_id=cc10be93-0a6f-4015-8f02-6e9e8ff3abed)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:13:54.730221 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:54.743267 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633cedf1-ba3c-4058-bce3-6f8d40dd9af1 req-581ed1f2-7195-479a-b8d5-faab1606e09a tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:54.744736 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-633cedf1-ba3c-4058-bce3-6f8d40dd9af1 req-581ed1f2-7195-479a-b8d5-faab1606e09a tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 932 time: 0.0795891 Nov 08 04:13:54.748740 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-b6cb08f4-1bff-4023-96d5-3da571938091 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8735242 Nov 08 04:13:54.765708 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b1d185-06a5-439a-84dd-9fd7475b7281 req-841376f0-d4cd-4c23-995d-6e381b223f43 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:54.767138 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-63b1d185-06a5-439a-84dd-9fd7475b7281 req-841376f0-d4cd-4c23-995d-6e381b223f43 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 948 time: 0.1007605 Nov 08 04:13:54.773233 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Request body: {'port': {'device_id': 'f3bac963-8704-4c45-bf9e-2320463cb1f8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:13:54.779270 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=f674fc7c-fe02-4d8c-9856-490782668990,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:55.145706 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-633cedf1-ba3c-4058-bce3-6f8d40dd9af1 req-947f852b-e669-481f-ae82-d27e15cca544 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3933864 Nov 08 04:13:55.151575 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-63b1d185-06a5-439a-84dd-9fd7475b7281 req-8a63001f-efc5-4b2c-893f-b8d11da4e8cb tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3651652 Nov 08 04:13:55.157213 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:55.215223 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['f674fc7c-fe02-4d8c-9856-490782668990'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:13:55.435101 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d84312ee-38b9-4f5e-bf0a-91096cbbfd1c {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:13:55.442813 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:55.454910 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Transition to ACTIVE for port object d84312ee-38b9-4f5e-bf0a-91096cbbfd1c will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:13:55.535718 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:55.590698 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Pushing event updated for resources: {'Port': ['ID=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:55.653638 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Attempting to bind port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:13:55.653972 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Attempting to bind port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '352fab34-f426-4ea6-a0d5-2c5b84c3f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:13:55.654294 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Attempting to bind port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c on network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:13:55.658423 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c on network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:13:55.658767 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Attempting to bind port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c on network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:13:55.663407 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 13, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:13:55.663739 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Checking segment: {'id': '352fab34-f426-4ea6-a0d5-2c5b84c3f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:13:55.664116 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Bound using segment: {'id': '352fab34-f426-4ea6-a0d5-2c5b84c3f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:13:55.664532 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Bound port: d84312ee-38b9-4f5e-bf0a-91096cbbfd1c, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '352fab34-f426-4ea6-a0d5-2c5b84c3f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:13:55.664874 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:55.726147 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] For port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:13:55.729351 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] For port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,segment=NetworkSegment(352fab34-f426-4ea6-a0d5-2c5b84c3f901),segment_id=352fab34-f426-4ea6-a0d5-2c5b84c3f901)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:13:55.804921 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:55.839607 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:55.840748 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:55.842115 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] 10.222.0.16 "PUT /v2.0/ports/d84312ee-38b9-4f5e-bf0a-91096cbbfd1c HTTP/1.1" status: 200 len: 1094 time: 1.0731976 Nov 08 04:13:55.842577 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f3bac963-8704-4c45-bf9e-2320463cb1f8', 'tag': 'd84312ee-38b9-4f5e-bf0a-91096cbbfd1c'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:13:55.844787 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-31cb27b7-08f8-4141-8eca-eaff8a7c3c42" -d '{"events": [{"name": "network-changed", "server_uuid": "f3bac963-8704-4c45-bf9e-2320463cb1f8", "tag": "d84312ee-38b9-4f5e-bf0a-91096cbbfd1c"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:13:55.868694 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a8f6cb-7504-4e02-99da-b531bec85be8 service neutron] Pushing event updated for resources: {'Port': ['ID=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:55.882908 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:13:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c292fa6-6ebf-4078-9674-ad513e38a46f x-openstack-request-id: req-4c292fa6-6ebf-4078-9674-ad513e38a46f {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:13:55.883195 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f3bac963-8704-4c45-bf9e-2320463cb1f8", "tag": "d84312ee-38b9-4f5e-bf0a-91096cbbfd1c", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:13:55.883586 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-4c292fa6-6ebf-4078-9674-ad513e38a46f {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:13:55.884034 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f3bac963-8704-4c45-bf9e-2320463cb1f8', 'tag': 'd84312ee-38b9-4f5e-bf0a-91096cbbfd1c', 'status': 'completed', 'code': 200} Nov 08 04:13:55.978577 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31cb27b7-08f8-4141-8eca-eaff8a7c3c42 req-081b8100-b1b7-4d48-b558-0195901bb8ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:55.979993 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31cb27b7-08f8-4141-8eca-eaff8a7c3c42 req-081b8100-b1b7-4d48-b558-0195901bb8ec service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=edc63d7a2a744b17a120c4d21149a2d0&device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 1097 time: 0.0395098 Nov 08 04:13:56.107733 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31cb27b7-08f8-4141-8eca-eaff8a7c3c42 req-dda3b53e-95a2-49e7-84af-7a4d70a0148e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:56.108895 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31cb27b7-08f8-4141-8eca-eaff8a7c3c42 req-dda3b53e-95a2-49e7-84af-7a4d70a0148e service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=edc63d7a2a744b17a120c4d21149a2d0&shared=False HTTP/1.1" status: 200 len: 909 time: 0.1037078 Nov 08 04:13:56.245567 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31cb27b7-08f8-4141-8eca-eaff8a7c3c42 req-06847379-699f-4033-93b1-d9d13f05990a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:56.253207 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31cb27b7-08f8-4141-8eca-eaff8a7c3c42 req-06847379-699f-4033-93b1-d9d13f05990a service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1250436 Nov 08 04:13:56.325571 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84582884-0bad-4381-a474-2df0c2590024 req-d379b134-a250-44ac-a062-f794ceca45f3 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:56.327206 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-84582884-0bad-4381-a474-2df0c2590024 req-d379b134-a250-44ac-a062-f794ceca45f3 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 949 time: 0.0910223 Nov 08 04:13:56.351566 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83639321-260a-4bdc-82c5-90fbcf80f261 req-def43387-c380-444f-add6-68295642c022 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:56.353666 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-83639321-260a-4bdc-82c5-90fbcf80f261 req-def43387-c380-444f-add6-68295642c022 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 944 time: 0.1045136 Nov 08 04:13:56.456175 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-270e6a09-0375-4828-a89a-75685ca50b04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:56.457641 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-270e6a09-0375-4828-a89a-75685ca50b04 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=edc63d7a2a744b17a120c4d21149a2d0&device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 1097 time: 0.1287184 Nov 08 04:13:56.467614 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-84582884-0bad-4381-a474-2df0c2590024 req-574b8dd5-a6ec-4fd9-8186-9058ccd2435d tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1110618 Nov 08 04:13:56.473866 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-83639321-260a-4bdc-82c5-90fbcf80f261 req-7cbb1f45-3074-4a77-99de-0fdcc6f565d8 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0977728 Nov 08 04:13:56.529398 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-c0453dfb-0602-4b88-998f-0bd8f8b586a8 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c HTTP/1.1" status: 200 len: 217 time: 0.0405178 Nov 08 04:13:56.579300 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-95d72a60-2cdc-464a-8673-c0b9f4d7643c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:56.585471 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-95d72a60-2cdc-464a-8673-c0b9f4d7643c service neutron] 10.222.0.16 "GET /v2.0/subnets?id=8fce9f14-c9c6-47d9-9ea8-c6a5dedd5ca7 HTTP/1.1" status: 200 len: 848 time: 0.0442975 Nov 08 04:13:56.627348 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-fcc94483-ef98-4b84-93d0-428633499a5f service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0246708 Nov 08 04:13:56.730055 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-ed91f705-23a7-4ab6-8841-06c4c849deb6 service neutron] 10.222.0.16 "GET /v2.0/networks/a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0905981 Nov 08 04:13:56.837253 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f04c23-1219-4167-8c69-a8f6f764af48 req-796fe461-7c7d-46c2-bedf-b8fbddafd234 service neutron] 10.222.0.16 "GET /v2.0/networks/a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924265 Nov 08 04:13:57.588398 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8447cd4-5597-42bf-b000-ed312fffc987 req-327bb700-4aff-49e5-bfcc-c3efa1d5ee85 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:57.591601 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8447cd4-5597-42bf-b000-ed312fffc987 req-327bb700-4aff-49e5-bfcc-c3efa1d5ee85 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 949 time: 0.0560241 Nov 08 04:13:57.669947 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8447cd4-5597-42bf-b000-ed312fffc987 req-541b9f7b-1e48-4032-8204-b983635ff7bc tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723460 Nov 08 04:13:57.685786 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80cd01a5-9769-41ce-84a9-926d732b6203 req-a2fcc891-d979-4e79-81cf-b3d80527bddc tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:57.687286 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80cd01a5-9769-41ce-84a9-926d732b6203 req-a2fcc891-d979-4e79-81cf-b3d80527bddc tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 944 time: 0.0723438 Nov 08 04:13:57.747123 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80cd01a5-9769-41ce-84a9-926d732b6203 req-e0b44a09-05c5-409c-9a82-18e9076659e9 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532787 Nov 08 04:13:57.782330 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c05db08-058d-4049-8697-1c22903324e2 req-7408a492-fe20-4ceb-afa9-8c8374e61f93 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:57.783868 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c05db08-058d-4049-8697-1c22903324e2 req-7408a492-fe20-4ceb-afa9-8c8374e61f93 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0570586 Nov 08 04:13:57.830473 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c05db08-058d-4049-8697-1c22903324e2 req-d1163cb8-5a97-4bfc-9354-1d2060f5504d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402999 Nov 08 04:13:58.327786 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device f674fc7c-fe02-4d8c-9856-490782668990 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:13:58.501407 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port f674fc7c-fe02-4d8c-9856-490782668990 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:13:58.505501 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port f674fc7c-fe02-4d8c-9856-490782668990 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:13:58.505829 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:58.582840 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:58.604507 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd45d2fc6-0c61-4a25-8469-0f73c32f86cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f674fc7c-fe02-4d8c-9856-490782668990'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:13:58.607339 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eda9f51c-5c93-4031-ae69-c5bf215ed3c2" -d '{"events": [{"server_uuid": "d45d2fc6-0c61-4a25-8469-0f73c32f86cb", "name": "network-vif-plugged", "status": "completed", "tag": "f674fc7c-fe02-4d8c-9856-490782668990"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:13:58.620144 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port f674fc7c-fe02-4d8c-9856-490782668990, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=f674fc7c-fe02-4d8c-9856-490782668990,segment=NetworkSegment(cc10be93-0a6f-4015-8f02-6e9e8ff3abed),segment_id=cc10be93-0a6f-4015-8f02-6e9e8ff3abed)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:13:58.645220 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:13:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dc8d5e89-dce5-4986-8834-0bf689f7547b x-openstack-request-id: req-dc8d5e89-dce5-4986-8834-0bf689f7547b {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:13:58.645584 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d45d2fc6-0c61-4a25-8469-0f73c32f86cb", "name": "network-vif-plugged", "status": "completed", "tag": "f674fc7c-fe02-4d8c-9856-490782668990", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:13:58.645838 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-dc8d5e89-dce5-4986-8834-0bf689f7547b {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:13:58.646229 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd45d2fc6-0c61-4a25-8469-0f73c32f86cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f674fc7c-fe02-4d8c-9856-490782668990', 'code': 200} Nov 08 04:13:58.670657 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:13:58.724999 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=f674fc7c-fe02-4d8c-9856-490782668990,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:13:58.797739 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7f3dff-10b2-4b11-a2f9-b0e0c764d163 req-6908e71b-f446-4a1c-b048-846a7df35bfe tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:58.799463 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9e7f3dff-10b2-4b11-a2f9-b0e0c764d163 req-6908e71b-f446-4a1c-b048-846a7df35bfe tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 950 time: 0.0575910 Nov 08 04:13:58.876502 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9e7f3dff-10b2-4b11-a2f9-b0e0c764d163 req-1c3a8790-6bbe-4119-9238-0d3858d0a017 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691895 Nov 08 04:13:58.894932 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b441c2d-5333-4d3e-9be5-3e2ee975b429 req-7f9e019a-7540-4ac4-a4c8-42d74384fe92 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:58.896492 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4b441c2d-5333-4d3e-9be5-3e2ee975b429 req-7f9e019a-7540-4ac4-a4c8-42d74384fe92 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 944 time: 0.0628715 Nov 08 04:13:58.954617 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4b441c2d-5333-4d3e-9be5-3e2ee975b429 req-f8e5eb1a-db6a-4f98-86da-fd338f79e500 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513020 Nov 08 04:13:58.995424 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4440abd-42fd-4433-b512-6d2d66846e75 req-c86e646b-9c5f-4ea6-87e6-384b0d312a7f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:58.996904 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d4440abd-42fd-4433-b512-6d2d66846e75 req-c86e646b-9c5f-4ea6-87e6-384b0d312a7f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0662692 Nov 08 04:13:59.076697 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69d7cc59-4449-4e07-9e4e-ed31166abef9 req-db67ca85-0379-43fa-a4ff-8889b5c24ae4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:59.078337 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-69d7cc59-4449-4e07-9e4e-ed31166abef9 req-db67ca85-0379-43fa-a4ff-8889b5c24ae4 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 1103 time: 0.0909171 Nov 08 04:13:59.081695 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d4440abd-42fd-4433-b512-6d2d66846e75 req-4f9c269a-7a33-4f08-ab3e-75b1664c6526 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0772257 Nov 08 04:13:59.126821 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-69d7cc59-4449-4e07-9e4e-ed31166abef9 req-153cc360-a751-40bd-b9cb-66e1910fe4cc service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399213 Nov 08 04:13:59.989173 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3ba9c0a-7563-42dd-9bbf-cdbd87048a5a req-b2e05feb-1e00-4777-9772-d998497ce9c6 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:13:59.990715 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e3ba9c0a-7563-42dd-9bbf-cdbd87048a5a req-b2e05feb-1e00-4777-9772-d998497ce9c6 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 950 time: 0.0472002 Nov 08 04:14:00.063025 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e3ba9c0a-7563-42dd-9bbf-cdbd87048a5a req-15dede1d-463b-4a4e-b8f9-1b26b76831cb tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655346 Nov 08 04:14:00.081938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4364a5df-e6ef-4a0e-810c-8a9971fd4a70 req-1f6d6952-2b6a-4693-bccd-b5dfeadca2dc tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:00.083384 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4364a5df-e6ef-4a0e-810c-8a9971fd4a70 req-1f6d6952-2b6a-4693-bccd-b5dfeadca2dc tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 944 time: 0.0602603 Nov 08 04:14:00.130746 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4364a5df-e6ef-4a0e-810c-8a9971fd4a70 req-90bf3767-c932-41c6-a493-e2b6bb815158 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414233 Nov 08 04:14:00.199346 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df2d9b70-506a-4488-9297-37383d9d94be req-b172e01c-8cab-4a9e-92bc-bde062ae3883 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:00.200862 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df2d9b70-506a-4488-9297-37383d9d94be req-b172e01c-8cab-4a9e-92bc-bde062ae3883 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0474203 Nov 08 04:14:00.249161 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df2d9b70-506a-4488-9297-37383d9d94be req-832c3636-abfa-4bfa-a210-fc2be176d156 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423174 Nov 08 04:14:00.320458 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d84312ee-38b9-4f5e-bf0a-91096cbbfd1c details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:14:00.415907 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,segment=NetworkSegment(352fab34-f426-4ea6-a0d5-2c5b84c3f901),segment_id=352fab34-f426-4ea6-a0d5-2c5b84c3f901)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:00.427820 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'd84312ee-38b9-4f5e-bf0a-91096cbbfd1c', 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7', 'port_id': 'd84312ee-38b9-4f5e-bf0a-91096cbbfd1c', 'mac_address': 'fa:16:3e:a4:4b:65', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 173, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8fce9f14-c9c6-47d9-9ea8-c6a5dedd5ca7', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:14:00.470566 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:00.485930 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d84312ee-38b9-4f5e-bf0a-91096cbbfd1c {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:14:00.508261 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,segment=NetworkSegment(352fab34-f426-4ea6-a0d5-2c5b84c3f901),segment_id=352fab34-f426-4ea6-a0d5-2c5b84c3f901)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:00.585542 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:00.632396 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:01.184152 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f120abfd-e8ea-4917-9462-6c435ef42168 req-31e730b7-3023-4c4d-925f-fa90a7720c51 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:01.185607 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f120abfd-e8ea-4917-9462-6c435ef42168 req-31e730b7-3023-4c4d-925f-fa90a7720c51 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 950 time: 0.0536289 Nov 08 04:14:01.260368 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f120abfd-e8ea-4917-9462-6c435ef42168 req-7f12425e-c69d-44fb-9731-146ba9481328 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688903 Nov 08 04:14:01.272128 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80036af9-6b8c-4abb-a09f-9c4ae6c92bf3 req-4945edcb-838d-48e2-a4eb-62fce82b1132 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:01.273435 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80036af9-6b8c-4abb-a09f-9c4ae6c92bf3 req-4945edcb-838d-48e2-a4eb-62fce82b1132 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 945 time: 0.0763798 Nov 08 04:14:01.284030 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['d84312ee-38b9-4f5e-bf0a-91096cbbfd1c'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:14:01.337106 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80036af9-6b8c-4abb-a09f-9c4ae6c92bf3 req-cc9f4ca1-14f8-413a-989a-fa3557c0964a tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570500 Nov 08 04:14:01.375245 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cf4de8-6507-424c-9b33-28780bb2ea5d req-5124eec7-9c1f-4633-b0c0-2e10bffd96c8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:01.376707 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e4cf4de8-6507-424c-9b33-28780bb2ea5d req-5124eec7-9c1f-4633-b0c0-2e10bffd96c8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0528808 Nov 08 04:14:01.428101 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e4cf4de8-6507-424c-9b33-28780bb2ea5d req-a8233e54-85bc-4104-94ad-d8a677b32e14 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455618 Nov 08 04:14:02.381841 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd96ae1-cc05-4c3f-b120-dc3308b9a374 req-b0cc3a65-e63c-4c18-865c-ac4d8a941ff9 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:02.383404 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ebd96ae1-cc05-4c3f-b120-dc3308b9a374 req-b0cc3a65-e63c-4c18-865c-ac4d8a941ff9 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 950 time: 0.0570431 Nov 08 04:14:02.463692 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ebd96ae1-cc05-4c3f-b120-dc3308b9a374 req-87c81458-606b-4a5d-98df-96e2f3860b92 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726669 Nov 08 04:14:02.488589 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e490bd08-7799-4fa6-acf4-6244fe5e10d3 req-816ceeb1-9f0d-4ade-b856-92f4ecf5aad8 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:02.490059 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e490bd08-7799-4fa6-acf4-6244fe5e10d3 req-816ceeb1-9f0d-4ade-b856-92f4ecf5aad8 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 945 time: 0.0775566 Nov 08 04:14:02.579155 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e490bd08-7799-4fa6-acf4-6244fe5e10d3 req-ca599812-e439-419b-939b-f3f91ebb3d68 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771246 Nov 08 04:14:02.610592 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f6b6af-1d4c-436a-88be-191e5c63062d req-67d93ffd-4474-4c78-8c4a-81ff8be7749c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:02.612502 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98f6b6af-1d4c-436a-88be-191e5c63062d req-67d93ffd-4474-4c78-8c4a-81ff8be7749c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0753756 Nov 08 04:14:02.664485 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98f6b6af-1d4c-436a-88be-191e5c63062d req-5bfd02d9-ac9a-4564-88d3-fbcbcdaf4a32 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456398 Nov 08 04:14:03.569915 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-544f7ce4-b456-4d4a-8f04-fcc768e3d0f8 req-0b462421-abc8-4bff-8462-9d4fcfc173bd tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:03.571232 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-544f7ce4-b456-4d4a-8f04-fcc768e3d0f8 req-0b462421-abc8-4bff-8462-9d4fcfc173bd tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 950 time: 0.0468955 Nov 08 04:14:03.626792 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-544f7ce4-b456-4d4a-8f04-fcc768e3d0f8 req-412396f0-1696-4f73-b8ec-41b224d7f31c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497162 Nov 08 04:14:03.718931 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cee9e05-4978-4428-9ee7-231718c58b8d req-14d05e98-137c-4dea-9970-2797f411f84c tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:03.720501 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8cee9e05-4978-4428-9ee7-231718c58b8d req-14d05e98-137c-4dea-9970-2797f411f84c tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 945 time: 0.0647762 Nov 08 04:14:03.767421 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8cee9e05-4978-4428-9ee7-231718c58b8d req-9d1b8775-98ba-40f4-9e9b-95750ff3c73c tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410435 Nov 08 04:14:03.870984 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d311ccd-dc56-45af-ba17-355aaec08af4 req-fafd6026-c60f-4aa6-8c48-30f6c93dabe5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:03.872920 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0d311ccd-dc56-45af-ba17-355aaec08af4 req-fafd6026-c60f-4aa6-8c48-30f6c93dabe5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0486114 Nov 08 04:14:03.919082 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0d311ccd-dc56-45af-ba17-355aaec08af4 req-42e3f9a7-b96f-49c6-bd92-db12afe0cde1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402815 Nov 08 04:14:04.097392 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4abf58ef-4352-414e-9470-59cfff61d02b req-821d0e76-1b28-4e8d-a6e0-f85b4bc1d6f9 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:04.098831 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4abf58ef-4352-414e-9470-59cfff61d02b req-821d0e76-1b28-4e8d-a6e0-f85b4bc1d6f9 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 950 time: 0.0458486 Nov 08 04:14:04.148293 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4abf58ef-4352-414e-9470-59cfff61d02b req-7152580d-442a-49f3-bc9a-e4a73effe084 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435627 Nov 08 04:14:04.344064 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d84312ee-38b9-4f5e-bf0a-91096cbbfd1c up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:04.445341 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:14:04.450549 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:04.450948 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:04.527992 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:04.551106 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f3bac963-8704-4c45-bf9e-2320463cb1f8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd84312ee-38b9-4f5e-bf0a-91096cbbfd1c'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:04.553333 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1164c757-baea-4bcd-8360-8e24feae760b" -d '{"events": [{"server_uuid": "f3bac963-8704-4c45-bf9e-2320463cb1f8", "name": "network-vif-plugged", "status": "completed", "tag": "d84312ee-38b9-4f5e-bf0a-91096cbbfd1c"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:04.566139 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,segment=NetworkSegment(352fab34-f426-4ea6-a0d5-2c5b84c3f901),segment_id=352fab34-f426-4ea6-a0d5-2c5b84c3f901)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:04.591381 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-116be386-dc5f-42e6-868a-dc3fcb7d2b8e x-openstack-request-id: req-116be386-dc5f-42e6-868a-dc3fcb7d2b8e {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:04.591677 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f3bac963-8704-4c45-bf9e-2320463cb1f8", "name": "network-vif-plugged", "status": "completed", "tag": "d84312ee-38b9-4f5e-bf0a-91096cbbfd1c", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:04.591928 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-116be386-dc5f-42e6-868a-dc3fcb7d2b8e {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:04.592317 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f3bac963-8704-4c45-bf9e-2320463cb1f8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd84312ee-38b9-4f5e-bf0a-91096cbbfd1c', 'code': 200} Nov 08 04:14:04.631531 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:04.683923 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:04.885550 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d52e11-a3ec-4219-80af-e390c9643e19 req-a688aeaf-801d-4c69-aa5b-45a8e5b2adbc tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:04.887642 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d8d52e11-a3ec-4219-80af-e390c9643e19 req-a688aeaf-801d-4c69-aa5b-45a8e5b2adbc tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 946 time: 0.0481143 Nov 08 04:14:04.942733 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d8d52e11-a3ec-4219-80af-e390c9643e19 req-b42ae2d7-a3a0-4d46-b16e-e0aa3b52a492 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486302 Nov 08 04:14:04.978530 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a38e956-c521-497c-9c10-13384b28dc36 req-029ca0d1-1269-4e2b-8f53-6d611be3938e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:04.980287 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8a38e956-c521-497c-9c10-13384b28dc36 req-029ca0d1-1269-4e2b-8f53-6d611be3938e service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 1099 time: 0.0536730 Nov 08 04:14:05.063664 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8a38e956-c521-497c-9c10-13384b28dc36 req-ecd1fa38-6d69-4588-a8b9-4c32a21af059 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695605 Nov 08 04:14:05.075638 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92a3e79e-005a-44d2-b431-fb351cffc28a req-882ce14c-0642-4191-b322-242198a1e0b3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:05.077271 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92a3e79e-005a-44d2-b431-fb351cffc28a req-882ce14c-0642-4191-b322-242198a1e0b3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0703938 Nov 08 04:14:05.125724 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92a3e79e-005a-44d2-b431-fb351cffc28a req-58041c35-6ad8-415c-b840-09ad67aed5ce tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424166 Nov 08 04:14:05.263062 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05561141-8c2d-409c-9698-106e263288b3 req-bcecf1ab-cf68-4500-9fb4-2912b4d003bc tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:05.264849 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-05561141-8c2d-409c-9698-106e263288b3 req-bcecf1ab-cf68-4500-9fb4-2912b4d003bc tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 950 time: 0.0507653 Nov 08 04:14:05.311569 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-05561141-8c2d-409c-9698-106e263288b3 req-d93f4bf6-f6f6-4b61-9bb7-ddc164830c15 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407584 Nov 08 04:14:06.062262 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc299472-73c8-4f4c-95f9-e993dec19bb2 req-35147bab-f89a-419c-a365-937fd4ba03dd tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:06.063702 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc299472-73c8-4f4c-95f9-e993dec19bb2 req-35147bab-f89a-419c-a365-937fd4ba03dd tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 946 time: 0.0462315 Nov 08 04:14:06.114030 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc299472-73c8-4f4c-95f9-e993dec19bb2 req-aa4ce56c-6441-4d2f-943f-e672d67a5e8f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443566 Nov 08 04:14:06.239378 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce5a86e-a8a3-4b94-8268-b8e63954747c req-c229a56e-74ba-47c3-bb8c-267975bb7b17 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:06.240701 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4ce5a86e-a8a3-4b94-8268-b8e63954747c req-c229a56e-74ba-47c3-bb8c-267975bb7b17 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0466897 Nov 08 04:14:06.286839 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4ce5a86e-a8a3-4b94-8268-b8e63954747c req-d0aa031b-c9b4-4058-a6ed-45604252c2d7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403969 Nov 08 04:14:06.423286 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb08dc9-40c0-4f10-95a0-2b1a6f9814a9 req-99000b08-e1a6-41db-84b7-7285603b7560 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:06.424812 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dfb08dc9-40c0-4f10-95a0-2b1a6f9814a9 req-99000b08-e1a6-41db-84b7-7285603b7560 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 950 time: 0.0475771 Nov 08 04:14:06.473117 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dfb08dc9-40c0-4f10-95a0-2b1a6f9814a9 req-19426a13-902e-4e54-b3bd-eee9c125381c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424390 Nov 08 04:14:07.131674 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-969b2856-6dc1-41d2-86ba-ceeb2c316ca4 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:07.133083 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-969b2856-6dc1-41d2-86ba-ceeb2c316ca4 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.16 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 950 time: 0.0492043 Nov 08 04:14:07.281039 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f281230-0bbd-4fc0-84b1-38c9a0c4834a req-0445423e-0d85-4af2-b6d8-41c15cb7c8b5 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:07.282534 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2f281230-0bbd-4fc0-84b1-38c9a0c4834a req-0445423e-0d85-4af2-b6d8-41c15cb7c8b5 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 946 time: 0.1018617 Nov 08 04:14:07.342026 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-200be9cd-efcb-4bd3-8b49-263e938c262c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Deleting port f674fc7c-fe02-4d8c-9856-490782668990 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:14:07.342359 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-200be9cd-efcb-4bd3-8b49-263e938c262c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:07.364003 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2f281230-0bbd-4fc0-84b1-38c9a0c4834a req-91b86d11-469b-43ff-a262-ddf9afd5cf76 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745029 Nov 08 04:14:07.459609 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18bed5f7-de11-4165-916f-38a6966c6875 req-676ba559-863a-4963-b4b6-173890ff0976 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:07.461067 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-18bed5f7-de11-4165-916f-38a6966c6875 req-676ba559-863a-4963-b4b6-173890ff0976 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1016731 Nov 08 04:14:07.476798 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-200be9cd-efcb-4bd3-8b49-263e938c262c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] For port f674fc7c-fe02-4d8c-9856-490782668990, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=f674fc7c-fe02-4d8c-9856-490782668990,segment=NetworkSegment(cc10be93-0a6f-4015-8f02-6e9e8ff3abed),segment_id=cc10be93-0a6f-4015-8f02-6e9e8ff3abed)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:07.477151 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-200be9cd-efcb-4bd3-8b49-263e938c262c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:07.502199 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-200be9cd-efcb-4bd3-8b49-263e938c262c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Calling delete_port for f674fc7c-fe02-4d8c-9856-490782668990 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:14:07.564056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-18bed5f7-de11-4165-916f-38a6966c6875 req-28e0a84b-8243-4591-90e0-18b07ec32ca0 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0961051 Nov 08 04:14:07.636780 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc8180ea-64df-4169-82b5-18dff4cd7c9b req-585d93d4-71e4-460f-aa40-04a094560c83 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:07.636780 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc8180ea-64df-4169-82b5-18dff4cd7c9b req-585d93d4-71e4-460f-aa40-04a094560c83 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 950 time: 0.0698133 Nov 08 04:14:07.722223 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc8180ea-64df-4169-82b5-18dff4cd7c9b req-048f1b67-2046-44ed-8fc9-fae2b26371c4 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/security-groups?id=3d16541d-cc40-4a8f-82cf-721d12a7d90c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809662 Nov 08 04:14:07.776382 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-200be9cd-efcb-4bd3-8b49-263e938c262c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:07.805272 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-200be9cd-efcb-4bd3-8b49-263e938c262c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Pushing event deleted for resources: {'Port': ['ID=f674fc7c-fe02-4d8c-9856-490782668990,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:07.822301 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['f674fc7c-fe02-4d8c-9856-490782668990'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:14:07.846113 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-200be9cd-efcb-4bd3-8b49-263e938c262c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] No DVR routers for this DVR port f674fc7c-fe02-4d8c-9856-490782668990 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:14:07.850324 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-200be9cd-efcb-4bd3-8b49-263e938c262c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:07.852250 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-24f31a4a-3d34-4a57-bd77-b551d6ba94a2 req-200be9cd-efcb-4bd3-8b49-263e938c262c tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.16 "DELETE /v2.0/ports/f674fc7c-fe02-4d8c-9856-490782668990 HTTP/1.1" status: 204 len: 173 time: 0.6451974 Nov 08 04:14:07.852682 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd45d2fc6-0c61-4a25-8469-0f73c32f86cb', 'name': 'network-vif-deleted', 'tag': 'f674fc7c-fe02-4d8c-9856-490782668990'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:07.854965 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5d14eec-3be2-4467-9d3c-36b2527052d1" -d '{"events": [{"server_uuid": "d45d2fc6-0c61-4a25-8469-0f73c32f86cb", "name": "network-vif-deleted", "tag": "f674fc7c-fe02-4d8c-9856-490782668990"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:07.896156 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91985235-1b5c-4716-b287-d6b52d01a25d x-openstack-request-id: req-91985235-1b5c-4716-b287-d6b52d01a25d {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:07.896575 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d45d2fc6-0c61-4a25-8469-0f73c32f86cb", "name": "network-vif-deleted", "tag": "f674fc7c-fe02-4d8c-9856-490782668990", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:07.901569 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-91985235-1b5c-4716-b287-d6b52d01a25d {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:07.901569 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd45d2fc6-0c61-4a25-8469-0f73c32f86cb', 'name': 'network-vif-deleted', 'tag': 'f674fc7c-fe02-4d8c-9856-490782668990', 'status': 'completed', 'code': 200} Nov 08 04:14:08.486350 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27efab96-1da8-4cd6-a952-201aa1aa0d54 req-c185e9f5-c4b3-4017-9cad-c3356393d16d tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:08.487770 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-27efab96-1da8-4cd6-a952-201aa1aa0d54 req-c185e9f5-c4b3-4017-9cad-c3356393d16d tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 946 time: 0.0527844 Nov 08 04:14:08.535945 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-27efab96-1da8-4cd6-a952-201aa1aa0d54 req-82479097-6074-4382-a756-0a2f063e44c1 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419128 Nov 08 04:14:08.683538 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bcbbfe9-9110-4f02-b932-553b515d7c24 req-c40d4052-b0ca-4d82-8629-62216d105f10 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:08.685012 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9bcbbfe9-9110-4f02-b932-553b515d7c24 req-c40d4052-b0ca-4d82-8629-62216d105f10 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0497739 Nov 08 04:14:08.730497 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9bcbbfe9-9110-4f02-b932-553b515d7c24 req-1d8a0e71-25e2-4672-b917-9365509cb647 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391273 Nov 08 04:14:08.827328 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dc0b9ecd-2a20-4c89-b643-227ff11a5050 req-cc67a887-071f-4e10-a5a3-3b5ce7bb9a44 tempest-VolumesNegativeTest-701810508 tempest-VolumesNegativeTest-701810508-project] 10.222.0.21 "GET /v2.0/ports?device_id=d45d2fc6-0c61-4a25-8469-0f73c32f86cb HTTP/1.1" status: 200 len: 210 time: 0.0252950 Nov 08 04:14:09.803284 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4beb2829-3eb1-4848-9884-b68d8a9880d5 req-69101cc1-8489-45ef-93ff-069cfef6180d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:09.804785 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4beb2829-3eb1-4848-9884-b68d8a9880d5 req-69101cc1-8489-45ef-93ff-069cfef6180d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0567961 Nov 08 04:14:09.908453 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41594cf-100c-4184-9010-a713372c431c req-9bf8499e-9e14-4764-8417-d93b898904de tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:09.909815 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d41594cf-100c-4184-9010-a713372c431c req-9bf8499e-9e14-4764-8417-d93b898904de tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1024601 Nov 08 04:14:09.917084 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4beb2829-3eb1-4848-9884-b68d8a9880d5 req-5ce5e8fd-883b-4e03-8f66-fb2f436d681f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0999558 Nov 08 04:14:09.951260 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6e4e7a-73ea-43b4-ade8-9a0e64b7e097 req-5e67548d-ef24-4622-8f09-079c2e75a417 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:09.951962 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f6e4e7a-73ea-43b4-ade8-9a0e64b7e097 req-5e67548d-ef24-4622-8f09-079c2e75a417 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 1098 time: 0.0880895 Nov 08 04:14:09.968805 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d41594cf-100c-4184-9010-a713372c431c req-d3b218a2-abb6-4587-8965-01e6d68c2545 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0502133 Nov 08 04:14:10.058630 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6e4e7a-73ea-43b4-ade8-9a0e64b7e097 req-590a740f-0b1a-4ba7-a409-2b4e88c88e41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:10.060082 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f6e4e7a-73ea-43b4-ade8-9a0e64b7e097 req-590a740f-0b1a-4ba7-a409-2b4e88c88e41 service neutron] 10.222.0.16 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 920 time: 0.0904524 Nov 08 04:14:10.117451 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f6e4e7a-73ea-43b4-ade8-9a0e64b7e097 req-3956b690-9194-4b96-9ccd-0495f60af7fc service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000 HTTP/1.1" status: 200 len: 217 time: 0.0354717 Nov 08 04:14:10.181144 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6e4e7a-73ea-43b4-ade8-9a0e64b7e097 req-7d8d53e5-1a8f-457a-86e3-8e4b6c37bddb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:10.182575 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f6e4e7a-73ea-43b4-ade8-9a0e64b7e097 req-7d8d53e5-1a8f-457a-86e3-8e4b6c37bddb service neutron] 10.222.0.16 "GET /v2.0/subnets?id=900a12a5-1baa-47e1-8b64-245dc70bc9f2 HTTP/1.1" status: 200 len: 859 time: 0.0538836 Nov 08 04:14:10.214430 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f6e4e7a-73ea-43b4-ade8-9a0e64b7e097 req-30d170ab-1bf6-4602-b5d9-48808cb3bbbd service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0225348 Nov 08 04:14:10.364341 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f6e4e7a-73ea-43b4-ade8-9a0e64b7e097 req-6532d3f3-41c8-4d83-91b4-89e56c32df6f service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1420939 Nov 08 04:14:10.390429 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-108763e5-c499-4291-bb5d-4c5d8b3fb827 req-58c4a51a-f13a-4dd5-8138-b389ea611540 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:10.395074 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-108763e5-c499-4291-bb5d-4c5d8b3fb827 req-58c4a51a-f13a-4dd5-8138-b389ea611540 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 946 time: 0.0718269 Nov 08 04:14:10.496228 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-108763e5-c499-4291-bb5d-4c5d8b3fb827 req-cd2c422c-6f8c-4dda-87c0-cc92608234bb tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0920660 Nov 08 04:14:10.517531 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f6e4e7a-73ea-43b4-ade8-9a0e64b7e097 req-f2690787-04ca-4068-b09e-af3e665f5ac1 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1211290 Nov 08 04:14:11.038859 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd41498-b8cc-4e98-8349-90df43098a59 req-d64b37bc-5de9-4887-80e6-af21ea659a54 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:11.040478 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fdd41498-b8cc-4e98-8349-90df43098a59 req-d64b37bc-5de9-4887-80e6-af21ea659a54 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0539367 Nov 08 04:14:11.118659 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fdd41498-b8cc-4e98-8349-90df43098a59 req-64b89545-7117-45b4-828a-4fe7a7a8d104 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628726 Nov 08 04:14:11.126012 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c75d611-514f-4f06-8e0b-cc1bc0b25fd5 req-4df4d29c-632c-4ebe-a462-c546822b6f53 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:11.127461 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6c75d611-514f-4f06-8e0b-cc1bc0b25fd5 req-4df4d29c-632c-4ebe-a462-c546822b6f53 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0823066 Nov 08 04:14:11.178439 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6c75d611-514f-4f06-8e0b-cc1bc0b25fd5 req-b8899a99-b3e4-43e7-8613-54e920e9591f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445557 Nov 08 04:14:11.620270 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea26d811-d764-4717-a02b-f933d8d898c1 req-46506630-767c-4c76-a1e6-65d473d10f66 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:11.621760 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea26d811-d764-4717-a02b-f933d8d898c1 req-46506630-767c-4c76-a1e6-65d473d10f66 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 946 time: 0.0583944 Nov 08 04:14:11.671918 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea26d811-d764-4717-a02b-f933d8d898c1 req-0110e424-514b-4758-8c82-be74ac8c2683 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436335 Nov 08 04:14:12.248438 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3bbd21-5582-4da9-b8e6-ea3af301f81b req-54ae09ee-8b01-4b01-84a4-f6b9e54a4215 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:12.250983 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ec3bbd21-5582-4da9-b8e6-ea3af301f81b req-54ae09ee-8b01-4b01-84a4-f6b9e54a4215 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0627217 Nov 08 04:14:12.341196 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ec3bbd21-5582-4da9-b8e6-ea3af301f81b req-e4bf8f8d-5504-48c9-b715-4e03fee099f6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0776498 Nov 08 04:14:12.359782 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be89170-35d0-4efa-a68d-d9d5ff0743d3 req-44e8e2c9-a77c-4236-a374-f675307526d7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:12.361381 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1be89170-35d0-4efa-a68d-d9d5ff0743d3 req-44e8e2c9-a77c-4236-a374-f675307526d7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0900233 Nov 08 04:14:12.415023 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1be89170-35d0-4efa-a68d-d9d5ff0743d3 req-72108743-ae34-4dff-b151-f226cc83ac38 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478663 Nov 08 04:14:12.469182 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device f674fc7c-fe02-4d8c-9856-490782668990 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:14:12.490043 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: f674fc7c-fe02-4d8c-9856-490782668990 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:14:12.490359 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device f674fc7c-fe02-4d8c-9856-490782668990 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:14:12.717862 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cec07227-6321-4315-8723-14cd6acd7237 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:12.861138 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-2b14f03f-3bef-45d1-b0cf-d2ab3c2a6ed4 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:12.862622 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-2b14f03f-3bef-45d1-b0cf-d2ab3c2a6ed4 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.16 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 946 time: 0.2903273 Nov 08 04:14:12.888080 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32db59b5-0293-41f8-9d04-88aa903191b6 req-ea954d64-da8b-408f-adf6-d84c7fde9e9b tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:12.891894 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32db59b5-0293-41f8-9d04-88aa903191b6 req-ea954d64-da8b-408f-adf6-d84c7fde9e9b tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 946 time: 0.0822704 Nov 08 04:14:12.986119 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32db59b5-0293-41f8-9d04-88aa903191b6 req-819fc7fc-75b6-4a34-834c-9dc78c63d847 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0769699 Nov 08 04:14:13.017326 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-5d42a055-f6fc-497c-9817-54592158df49 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Deleting port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:14:13.017665 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-5d42a055-f6fc-497c-9817-54592158df49 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:13.109830 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-5d42a055-f6fc-497c-9817-54592158df49 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] For port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,segment=NetworkSegment(352fab34-f426-4ea6-a0d5-2c5b84c3f901),segment_id=352fab34-f426-4ea6-a0d5-2c5b84c3f901)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:13.110192 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-5d42a055-f6fc-497c-9817-54592158df49 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:13.122641 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-5d42a055-f6fc-497c-9817-54592158df49 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Calling delete_port for d84312ee-38b9-4f5e-bf0a-91096cbbfd1c owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:14:13.330573 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-5d42a055-f6fc-497c-9817-54592158df49 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:13.359198 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d42a055-f6fc-497c-9817-54592158df49 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Pushing event deleted for resources: {'Port': ['ID=d84312ee-38b9-4f5e-bf0a-91096cbbfd1c,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:13.380845 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['d84312ee-38b9-4f5e-bf0a-91096cbbfd1c'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:14:13.400667 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-5d42a055-f6fc-497c-9817-54592158df49 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] No DVR routers for this DVR port d84312ee-38b9-4f5e-bf0a-91096cbbfd1c on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:14:13.403446 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-5d42a055-f6fc-497c-9817-54592158df49 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:13.406791 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-50376e14-fe01-4518-8e96-9e564c4ecc41 req-5d42a055-f6fc-497c-9817-54592158df49 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.16 "DELETE /v2.0/ports/d84312ee-38b9-4f5e-bf0a-91096cbbfd1c HTTP/1.1" status: 204 len: 173 time: 0.5376654 Nov 08 04:14:13.407231 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f3bac963-8704-4c45-bf9e-2320463cb1f8', 'name': 'network-vif-deleted', 'tag': 'd84312ee-38b9-4f5e-bf0a-91096cbbfd1c'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:13.410828 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d295b0fd-e964-4b17-a706-185f5335260b" -d '{"events": [{"server_uuid": "f3bac963-8704-4c45-bf9e-2320463cb1f8", "name": "network-vif-deleted", "tag": "d84312ee-38b9-4f5e-bf0a-91096cbbfd1c"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:13.452592 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-147f80d6-3582-4031-9ac9-bd044c8a1571 x-openstack-request-id: req-147f80d6-3582-4031-9ac9-bd044c8a1571 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:13.452885 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f3bac963-8704-4c45-bf9e-2320463cb1f8", "name": "network-vif-deleted", "tag": "d84312ee-38b9-4f5e-bf0a-91096cbbfd1c", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:13.453195 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-147f80d6-3582-4031-9ac9-bd044c8a1571 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:13.453580 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f3bac963-8704-4c45-bf9e-2320463cb1f8', 'name': 'network-vif-deleted', 'tag': 'd84312ee-38b9-4f5e-bf0a-91096cbbfd1c', 'status': 'completed', 'code': 200} Nov 08 04:14:13.476679 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a63c62-03ca-49b5-9666-beae5d8f8bae req-d85bc7dc-7ef3-478d-9a96-31359745e741 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:13.478368 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85a63c62-03ca-49b5-9666-beae5d8f8bae req-d85bc7dc-7ef3-478d-9a96-31359745e741 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0584431 Nov 08 04:14:13.563022 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85a63c62-03ca-49b5-9666-beae5d8f8bae req-daf49c2b-022e-46fe-a855-fa6fd6c9b5c2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735970 Nov 08 04:14:13.578812 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7eccc2-8376-4010-944b-8c4fddc85280 req-03422ccd-eea2-43eb-9b84-b7b25586b497 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:13.582975 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9e7eccc2-8376-4010-944b-8c4fddc85280 req-03422ccd-eea2-43eb-9b84-b7b25586b497 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0728850 Nov 08 04:14:13.631265 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9e7eccc2-8376-4010-944b-8c4fddc85280 req-ce73d0eb-2030-48ca-b1ff-688d32ff0a21 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447257 Nov 08 04:14:14.099063 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-601f32e3-3168-488d-8dd7-46a151b65a21 req-975dcefb-5d31-4669-a9f3-84a8c8c2993d tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=f3bac963-8704-4c45-bf9e-2320463cb1f8 HTTP/1.1" status: 200 len: 210 time: 0.0302610 Nov 08 04:14:14.687310 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ddb86c-2c69-4f09-b8cc-4990db44d205 req-3ede2732-b3ff-45b9-87ff-c037cbf8105f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:14.688928 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a3ddb86c-2c69-4f09-b8cc-4990db44d205 req-3ede2732-b3ff-45b9-87ff-c037cbf8105f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0532401 Nov 08 04:14:14.761072 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a3ddb86c-2c69-4f09-b8cc-4990db44d205 req-ddb7bd38-ec1f-4d9f-8e25-aa863616f6e0 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662642 Nov 08 04:14:14.780701 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f71291c-1a51-4d65-9aac-11335ae465ce req-d5dda0ef-3ca1-4bcb-95a5-aea83f73721b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:14.782278 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f71291c-1a51-4d65-9aac-11335ae465ce req-d5dda0ef-3ca1-4bcb-95a5-aea83f73721b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0603209 Nov 08 04:14:14.829668 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f71291c-1a51-4d65-9aac-11335ae465ce req-c2160415-ad81-4e44-b80f-fc0a609ae0cd tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405304 Nov 08 04:14:15.156640 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-73d41e5c-ee4a-4763-80f1-51187587d10d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:15.356860 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-f67b5168-fd0c-408c-afca-b313126eece1 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:15.359173 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-f67b5168-fd0c-408c-afca-b313126eece1 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/networks?id=a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 HTTP/1.1" status: 200 len: 808 time: 0.1027095 Nov 08 04:14:15.373827 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-6d26be71-dde6-46e4-860c-dea12ae09ee3 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/quotas/edc63d7a2a744b17a120c4d21149a2d0 HTTP/1.1" status: 200 len: 375 time: 0.0088549 Nov 08 04:14:15.404229 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-0edc957e-063d-42df-b086-1a9e95bf99c4 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=edc63d7a2a744b17a120c4d21149a2d0&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0249655 Nov 08 04:14:15.463637 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 53786) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:15.502972 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-a38807cc-7ff9-458b-b93e-58e89c847c90 service neutron] 10.222.0.21 "GET /v2.0/networks/a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0912199 Nov 08 04:14:15.604130 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-020a9003-751d-427e-9b98-6a1626a7f472 service neutron] 10.222.0.21 "GET /v2.0/networks/a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0945728 Nov 08 04:14:15.736023 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-2bcf032f-5188-4ac9-889c-3cb8ebab4278 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=a5f11ad5c7cb47a294236806767980a4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2711275 Nov 08 04:14:15.738371 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 53796) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:15.786979 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f66b4c46-f0ea-412b-9293-0b68b3e46d17 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:15.821614 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f66b4c46-f0ea-412b-9293-0b68b3e46d17 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:15.868840 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6630ee57-7e04-471a-ac88-7defa5fe2a38 req-7d94da61-0a08-4205-a756-a7af92ee292b tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 210 time: 0.0449283 Nov 08 04:14:15.924317 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f8d411-7d35-44ca-9d78-e9e6217582e2 req-538c1081-d851-4cbd-ac68-263cddc659fb tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:15.925888 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51f8d411-7d35-44ca-9d78-e9e6217582e2 req-538c1081-d851-4cbd-ac68-263cddc659fb tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0865397 Nov 08 04:14:15.974282 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:16.006115 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f66b4c46-f0ea-412b-9293-0b68b3e46d17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:16.008636 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f66b4c46-f0ea-412b-9293-0b68b3e46d17 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:16.009752 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f66b4c46-f0ea-412b-9293-0b68b3e46d17 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/3d16541d-cc40-4a8f-82cf-721d12a7d90c HTTP/1.1" status: 204 len: 168 time: 0.2704582 Nov 08 04:14:16.017218 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51f8d411-7d35-44ca-9d78-e9e6217582e2 req-d02b103f-0ce7-4f93-a8af-8bc670def947 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838752 Nov 08 04:14:16.024595 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f66b4c46-f0ea-412b-9293-0b68b3e46d17 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d16541d-cc40-4a8f-82cf-721d12a7d90c,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:16.035415 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb21b17-72ba-4c23-a130-d9ee207ea527 req-05d7ecda-4e85-4302-8a72-5a7c84b0c44c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:16.036316 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-acb21b17-72ba-4c23-a130-d9ee207ea527 req-05d7ecda-4e85-4302-8a72-5a7c84b0c44c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0858257 Nov 08 04:14:16.092359 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-acb21b17-72ba-4c23-a130-d9ee207ea527 req-745a5237-1051-4f3f-8341-c24279981c4b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467398 Nov 08 04:14:16.488646 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d84312ee-38b9-4f5e-bf0a-91096cbbfd1c no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:14:16.509178 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: d84312ee-38b9-4f5e-bf0a-91096cbbfd1c {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:14:16.509517 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d84312ee-38b9-4f5e-bf0a-91096cbbfd1c not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:14:16.973590 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bbe2a0c2-ee6d-4139-8f6b-1317a1852d37 req-181ba775-f63a-45a5-b058-3e6822c6f217 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 210 time: 0.0281596 Nov 08 04:14:17.064891 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 53848) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:17.179995 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96e81b2e-ca04-40e3-9700-9165be194458 req-eedb6966-f39f-4976-b9af-171cc9c89bbb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:17.181456 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-96e81b2e-ca04-40e3-9700-9165be194458 req-eedb6966-f39f-4976-b9af-171cc9c89bbb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0817833 Nov 08 04:14:17.187351 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-2112909676-network', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:17.208393 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1896a0a3-2103-48f0-9a25-dc907ffc9467 req-d7777b23-895b-442f-91ab-49757b6916c1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:17.209836 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1896a0a3-2103-48f0-9a25-dc907ffc9467 req-d7777b23-895b-442f-91ab-49757b6916c1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0993690 Nov 08 04:14:17.286568 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-96e81b2e-ca04-40e3-9700-9165be194458 req-4858a929-a716-4555-80b5-e2ab8ce79a75 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0945435 Nov 08 04:14:17.290990 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1896a0a3-2103-48f0-9a25-dc907ffc9467 req-88d3eb09-3b40-412e-90c6-e862e2136d8a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701470 Nov 08 04:14:17.324412 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Made reservation on behalf of aa58a6fe20a449858977c517ca68518b for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:14:17.326792 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:17.336935 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:17.412888 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5259255c-bfed-405d-8142-3d1ef0c0a631 req-bc89958a-1ba2-45bc-8107-b3e9e5de53f3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:17.414260 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5259255c-bfed-405d-8142-3d1ef0c0a631 req-bc89958a-1ba2-45bc-8107-b3e9e5de53f3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0695417 Nov 08 04:14:17.488578 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5259255c-bfed-405d-8142-3d1ef0c0a631 req-b5bdb106-267c-4a6b-8476-f69d483e5831 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0653868 Nov 08 04:14:17.490299 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:17.575989 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:17.601034 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] vlan segment allocate from pool success with {'vlan_id': 186, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:14:17.609958 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:17.611020 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22c8203d-3e2c-47a8-a396-c049fabeeaaa,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:17.615605 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:17.619642 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Added segment 45e39c1d-17e6-4d15-9e5d-2931daeb0af1 of type vlan for network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 Nov 08 04:14:17.654601 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:17.741281 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:17.742460 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:17.743062 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:17.807979 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] Pushing event updated for resources: {'Network': ['ID=16cbde97-55ea-47f6-bd55-cf46e7c41a49,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:17.818990 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:14:17.854208 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f7f3fe7c-cdc4-454d-a819-3916636278a9 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7880762 Nov 08 04:14:17.854338 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 53858) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:17.859306 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Request body: {'subnet': {'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-2112909676-subnet', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:17.958824 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Made reservation on behalf of aa58a6fe20a449858977c517ca68518b for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:14:17.963570 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5043309'] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:18.072119 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1583e2b6-e462-4e7e-8ef2-96f8f3c327bb req-2b62fbe3-8fc1-431e-97b2-6c53635cd892 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 210 time: 0.0280530 Nov 08 04:14:18.180204 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-91849571-a1e2-4e69-afb8-10223f324321 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:18.181655 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-91849571-a1e2-4e69-afb8-10223f324321 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.16 "GET /v2.0/networks?id=a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 HTTP/1.1" status: 200 len: 808 time: 0.1122632 Nov 08 04:14:18.204916 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5120956', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5043607'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:18.220981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Request body: {'port': {'device_id': 'd17b73e9-e1f4-4e15-97e0-4239d5edc964', 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7', 'admin_state_up': True, 'tenant_id': 'edc63d7a2a744b17a120c4d21149a2d0'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:18.269408 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5926063e-8f31-4623-9cfc-4a0b577bdb41,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:18.277562 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Checking segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:14:18.278050 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Network hostable DHCP agents. Network: 16cbde97-55ea-47f6-bd55-cf46e7c41a49, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:14:18.362499 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:14:18.427486 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:18.447979 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193941f6-e541-493a-86e0-b2d83ea007f6 req-1e861171-a73a-4628-b52c-b1c81f33007b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:18.449431 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-193941f6-e541-493a-86e0-b2d83ea007f6 req-1e861171-a73a-4628-b52c-b1c81f33007b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0707870 Nov 08 04:14:18.454778 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 16cbde97-55ea-47f6-bd55-cf46e7c41a49) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:18.458291 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d8a7194-b863-44b8-af15-b2fb186b0ae0 req-58ae42aa-6a5d-4f8d-987b-3b70b0f7fc3e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:18.459875 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6d8a7194-b863-44b8-af15-b2fb186b0ae0 req-58ae42aa-6a5d-4f8d-987b-3b70b0f7fc3e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0914066 Nov 08 04:14:18.462464 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Made reservation on behalf of edc63d7a2a744b17a120c4d21149a2d0 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:14:18.464686 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c794c81-5cc3-49e3-93a6-88e8a1d6c43a None None] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:14:18.465733 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:18.468212 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:18.469014 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:18.562619 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-d373e27e-b7d5-41f5-b0e5-baa4b33e06c8 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.7072272 Nov 08 04:14:18.568716 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 53878) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:18.568716 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:18.588134 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-193941f6-e541-493a-86e0-b2d83ea007f6 req-5bef7f55-b691-4465-8c8c-455188d395a4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1271155 Nov 08 04:14:18.624743 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6d8a7194-b863-44b8-af15-b2fb186b0ae0 req-c5c17064-74a1-450c-a1fa-3e22c5631bb2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1347711 Nov 08 04:14:18.696280 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Allocated IP 172.20.0.10 (a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7/8fce9f14-c9c6-47d9-9ea8-c6a5dedd5ca7/64b004cc-acbd-488d-8f5d-2b3d5f02a667) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:14:18.696545 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-701463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7538'] for router, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:18.698699 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-701603', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-688686', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-770197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7531'] for router, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:18.724844 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp69aa137b-4136-5a6b-bf5e-deeb8c067c65-16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41'}]}} from dv-cinder-783643-4-iscsi. {{(pid=101666) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 04:14:18.725720 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:18.744351 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9f50711-1316-4c96-9c4a-c4ffe5d91071 req-382f0ffc-1926-438d-a886-4a77c0876b59 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:18.746590 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a9f50711-1316-4c96-9c4a-c4ffe5d91071 req-382f0ffc-1926-438d-a886-4a77c0876b59 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0825357 Nov 08 04:14:18.813431 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:18.886231 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.db_base_plugin_common [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Allocated IP 172.20.0.2 (16cbde97-55ea-47f6-bd55-cf46e7c41a49/5926063e-8f31-4623-9cfc-4a0b577bdb41/b32ebd58-f404-4758-8887-7264a2e490fc) {{(pid=101666) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:14:18.909931 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a9f50711-1316-4c96-9c4a-c4ffe5d91071 req-5e281145-e585-4a55-8bb2-9b3850dba4f5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1535616 Nov 08 04:14:18.983049 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.086418 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.101812 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Publish callbacks [] for port, precommit_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.119545 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.169137 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:14:19.182878 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:19.213680 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:14:19.217050 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.253716 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 is already hosted by enough agents. {{(pid=101666) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:14:19.260317 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.base_scheduler [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Resources bound (agent type, host, resource id): {{(pid=101666) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:19.264060 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Received port after_create {{(pid=101666) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:14:19.271234 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Pushing event updated for resources: {'Port': ['ID=b32ebd58-f404-4758-8887-7264a2e490fc,revision_number=1']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:19.293949 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:19.295315 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.303186 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Pushing event updated for resources: {'Port': ['ID=64b004cc-acbd-488d-8f5d-2b3d5f02a667,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:19.330727 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1053e426-88d0-4f1e-9050-a71706a11769 req-042acbae-1221-4c41-8db3-53d450e130de tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:19.335499 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1053e426-88d0-4f1e-9050-a71706a11769 req-042acbae-1221-4c41-8db3-53d450e130de tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 932 time: 0.1696243 Nov 08 04:14:19.335634 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Attempting to bind port b32ebd58-f404-4758-8887-7264a2e490fc on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:14:19.335634 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Attempting to bind port b32ebd58-f404-4758-8887-7264a2e490fc by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:14:19.336142 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Attempting to bind port b32ebd58-f404-4758-8887-7264a2e490fc on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:14:19.341795 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 14, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:14:19.342165 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Checking segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:14:19.342592 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.342976 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Bound using segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:14:19.343456 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Bound port: b32ebd58-f404-4758-8887-7264a2e490fc, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:14:19.343826 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.386337 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-96812f6d-b8e8-47ee-9233-032ffd9be35f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1713717 Nov 08 04:14:19.407329 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1053e426-88d0-4f1e-9050-a71706a11769 req-573876c1-497b-419c-83bd-2dcb8e0cf4f9 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683832 Nov 08 04:14:19.414096 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Request body: {'port': {'device_id': 'd17b73e9-e1f4-4e15-97e0-4239d5edc964', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:19.443339 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] For port b32ebd58-f404-4758-8887-7264a2e490fc, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:14:19.446833 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] For port b32ebd58-f404-4758-8887-7264a2e490fc, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=b32ebd58-f404-4758-8887-7264a2e490fc,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:14:19.469740 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.485377 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.504551 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.612085 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.613628 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Allocated IP 172.27.2.70 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/38a2e2c4-b937-4b0b-b49d-6dbbc4e31925) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:14:19.722372 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b057099a-c330-404f-95e3-b7e0ef1d157c None None] Pushing event updated for resources: {'Port': ['ID=b32ebd58-f404-4758-8887-7264a2e490fc,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:19.787662 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.877002 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 64b004cc-acbd-488d-8f5d-2b3d5f02a667 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:14:19.890027 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.901799 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:19.902009 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488dacbd-1c16-4e50-8b1b-dd73d5a2e9f2 req-ef9265fd-375d-4c25-bc86-1a07594846cd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:19.907790 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-488dacbd-1c16-4e50-8b1b-dd73d5a2e9f2 req-ef9265fd-375d-4c25-bc86-1a07594846cd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1300142 Nov 08 04:14:19.928988 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d32be9d3-3f27-4294-a984-f6f51b817aa4 req-a9bf99df-a7dd-4333-aa30-ca25a4ed9d46 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:19.932079 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d32be9d3-3f27-4294-a984-f6f51b817aa4 req-a9bf99df-a7dd-4333-aa30-ca25a4ed9d46 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 946 time: 0.1603045 Nov 08 04:14:19.960429 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:14:19.963399 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:19.966847 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:14:19.967694 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Transition to ACTIVE for port object 64b004cc-acbd-488d-8f5d-2b3d5f02a667 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:14:19.998457 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Pushing event updated for resources: {'Port': ['ID=38a2e2c4-b937-4b0b-b49d-6dbbc4e31925,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:20.037387 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-488dacbd-1c16-4e50-8b1b-dd73d5a2e9f2 req-7ed90a8b-764d-4579-96db-53611ef287c4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1040986 Nov 08 04:14:20.055729 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d32be9d3-3f27-4294-a984-f6f51b817aa4 req-8ce6f6f7-0df8-48f6-88c1-dcd4c52d3cef tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1041999 Nov 08 04:14:20.090765 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:20.196587 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Pushing event updated for resources: {'Port': ['ID=64b004cc-acbd-488d-8f5d-2b3d5f02a667,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:20.237072 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3c3a3ab-1fef-4970-bbbf-a35f6ca37019 req-7629db0f-cb82-4dae-aa44-665f15a34641 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:20.238691 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f3c3a3ab-1fef-4970-bbbf-a35f6ca37019 req-7629db0f-cb82-4dae-aa44-665f15a34641 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1168540 Nov 08 04:14:20.272588 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b240c1-89aa-4e7b-9b20-6ac8c896aea4 req-3d84bf09-1efb-4593-81af-fbdc04d0fe8e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:20.273903 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9b240c1-89aa-4e7b-9b20-6ac8c896aea4 req-3d84bf09-1efb-4593-81af-fbdc04d0fe8e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1393754 Nov 08 04:14:20.326545 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:20.359406 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Attempting to bind port 64b004cc-acbd-488d-8f5d-2b3d5f02a667 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:14:20.359757 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Attempting to bind port 64b004cc-acbd-488d-8f5d-2b3d5f02a667 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '352fab34-f426-4ea6-a0d5-2c5b84c3f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:14:20.360083 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Attempting to bind port 64b004cc-acbd-488d-8f5d-2b3d5f02a667 on network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:14:20.370978 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f3c3a3ab-1fef-4970-bbbf-a35f6ca37019 req-6ea1a9f4-56d4-4ad8-8b18-58154218853b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1090519 Nov 08 04:14:20.374383 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9b240c1-89aa-4e7b-9b20-6ac8c896aea4 req-105b14ca-1238-4ccf-adef-fe489f0da2af tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0933428 Nov 08 04:14:20.375085 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Port 64b004cc-acbd-488d-8f5d-2b3d5f02a667 on network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:14:20.375936 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Attempting to bind port 64b004cc-acbd-488d-8f5d-2b3d5f02a667 on network a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:14:20.382136 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 13, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:14:20.382471 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Checking segment: {'id': '352fab34-f426-4ea6-a0d5-2c5b84c3f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:14:20.382877 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Bound using segment: {'id': '352fab34-f426-4ea6-a0d5-2c5b84c3f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:14:20.383301 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Bound port: 64b004cc-acbd-488d-8f5d-2b3d5f02a667, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '352fab34-f426-4ea6-a0d5-2c5b84c3f901', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 173, 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:14:20.383649 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:20.476516 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] For port 64b004cc-acbd-488d-8f5d-2b3d5f02a667, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:14:20.485398 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] For port 64b004cc-acbd-488d-8f5d-2b3d5f02a667, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=64b004cc-acbd-488d-8f5d-2b3d5f02a667,segment=NetworkSegment(352fab34-f426-4ea6-a0d5-2c5b84c3f901),segment_id=352fab34-f426-4ea6-a0d5-2c5b84c3f901)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:14:20.504936 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device e6483e56-c377-4575-bd34-b26a5c2bf382 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:14:20.542298 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b049e445-2c6a-4a1d-aa73-b69caaf3faf4 req-18733957-3480-474e-a2dd-8d3637875b31 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:20.544552 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b049e445-2c6a-4a1d-aa73-b69caaf3faf4 req-18733957-3480-474e-a2dd-8d3637875b31 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 944 time: 0.0575490 Nov 08 04:14:20.556925 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-701612', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891'] for router, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:20.600584 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:20.611743 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b049e445-2c6a-4a1d-aa73-b69caaf3faf4 req-25a5b787-7ae6-49e8-b754-f41526d3471d tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610380 Nov 08 04:14:20.639666 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:20.640348 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:20.642819 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] 10.222.0.16 "PUT /v2.0/ports/64b004cc-acbd-488d-8f5d-2b3d5f02a667 HTTP/1.1" status: 200 len: 1094 time: 1.2336404 Nov 08 04:14:20.645053 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd17b73e9-e1f4-4e15-97e0-4239d5edc964', 'tag': '64b004cc-acbd-488d-8f5d-2b3d5f02a667'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:20.645190 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:20.647327 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7bcdd0c4-4841-40ce-9b10-9d5ef3201eb5" -d '{"events": [{"name": "network-changed", "server_uuid": "d17b73e9-e1f4-4e15-97e0-4239d5edc964", "tag": "64b004cc-acbd-488d-8f5d-2b3d5f02a667"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:20.664088 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'port_id': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'mac_address': 'fa:16:3e:b2:b0:ef', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 184, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:14:20.678223 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c46e3a45-9a80-4a18-839c-8d7a5372b94a service neutron] Pushing event updated for resources: {'Port': ['ID=64b004cc-acbd-488d-8f5d-2b3d5f02a667,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:20.701513 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9c1c9693-a8b2-4796-9840-86d8c4f82c1c x-openstack-request-id: req-9c1c9693-a8b2-4796-9840-86d8c4f82c1c {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:20.702027 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d17b73e9-e1f4-4e15-97e0-4239d5edc964", "tag": "64b004cc-acbd-488d-8f5d-2b3d5f02a667", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:20.702901 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-9c1c9693-a8b2-4796-9840-86d8c4f82c1c {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:20.703315 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd17b73e9-e1f4-4e15-97e0-4239d5edc964', 'tag': '64b004cc-acbd-488d-8f5d-2b3d5f02a667', 'status': 'completed', 'code': 200} Nov 08 04:14:20.717049 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:20.738453 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id e6483e56-c377-4575-bd34-b26a5c2bf382 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:14:20.763544 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:20.828589 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bcdd0c4-4841-40ce-9b10-9d5ef3201eb5 req-068f47fd-a749-49e4-a3f1-ca2b1eb6bbe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:20.830094 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7bcdd0c4-4841-40ce-9b10-9d5ef3201eb5 req-068f47fd-a749-49e4-a3f1-ca2b1eb6bbe8 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=edc63d7a2a744b17a120c4d21149a2d0&device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 1097 time: 0.0489931 Nov 08 04:14:20.834060 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:20.870019 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97b4ed6f-164b-4656-8950-b5db56a0c5a4 None None] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:14:20.952265 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=6']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:20.960368 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-28d287e5-3a1c-459b-9f12-ba56770f11a8 None None] Provisioning complete for port b32ebd58-f404-4758-8887-7264a2e490fc triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:20.960851 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-28d287e5-3a1c-459b-9f12-ba56770f11a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:20.977203 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bcdd0c4-4841-40ce-9b10-9d5ef3201eb5 req-7ba6acc6-ad71-45ba-ae70-207aa0a651d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:20.980395 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7bcdd0c4-4841-40ce-9b10-9d5ef3201eb5 req-7ba6acc6-ad71-45ba-ae70-207aa0a651d5 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=edc63d7a2a744b17a120c4d21149a2d0&shared=False HTTP/1.1" status: 200 len: 909 time: 0.1255083 Nov 08 04:14:21.087797 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Router 8aa2c265-b728-4ac3-97de-f276d80d2037 is scheduled to L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 with binding_index 1 {{(pid=101664) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 04:14:21.124126 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-28d287e5-3a1c-459b-9f12-ba56770f11a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:21.138070 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['e6483e56-c377-4575-bd34-b26a5c2bf382'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:14:21.153373 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bcdd0c4-4841-40ce-9b10-9d5ef3201eb5 req-375b3716-caae-488f-921f-abb386de1f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:21.155314 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7bcdd0c4-4841-40ce-9b10-9d5ef3201eb5 req-375b3716-caae-488f-921f-abb386de1f22 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1658447 Nov 08 04:14:21.254647 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58fe4276-9522-4a82-9221-c58af5e18f98 req-2f67ad93-dec3-4cd2-a699-de1f027d1b01 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:21.256302 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58fe4276-9522-4a82-9221-c58af5e18f98 req-2f67ad93-dec3-4cd2-a699-de1f027d1b01 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 946 time: 0.0982597 Nov 08 04:14:21.269033 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:14:21.280557 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Sync routers for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:14:21.287893 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ac00333-5311-426c-be06-9f706f0dcded req-c633ee2e-81d0-4492-8a78-904838a3b28f tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:21.289404 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7ac00333-5311-426c-be06-9f706f0dcded req-c633ee2e-81d0-4492-8a78-904838a3b28f tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1216266 Nov 08 04:14:21.294633 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:14:21.294633 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:14:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:21.321537 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device b32ebd58-f404-4758-8887-7264a2e490fc up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:21.370771 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:21.374686 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-75b960cc-2a86-4bf6-8b88-db7f98a4f991 admin admin] 10.222.0.21 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.8076723 Nov 08 04:14:21.375019 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 53926) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:21.414951 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-28d287e5-3a1c-459b-9f12-ba56770f11a8 None None] For port b32ebd58-f404-4758-8887-7264a2e490fc, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=b32ebd58-f404-4758-8887-7264a2e490fc,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:21.418203 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:14:21.512363 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-28d287e5-3a1c-459b-9f12-ba56770f11a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:21.520400 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port b32ebd58-f404-4758-8887-7264a2e490fc triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:21.520764 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:21.687291 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-36d10215-8d24-4ffb-88f0-77d00994ff96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:21.697275 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-36d10215-8d24-4ffb-88f0-77d00994ff96 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=edc63d7a2a744b17a120c4d21149a2d0&device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 1097 time: 0.4049411 Nov 08 04:14:21.701248 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58fe4276-9522-4a82-9221-c58af5e18f98 req-4f074568-fc01-4c80-8012-9f72b689c15a tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4364979 Nov 08 04:14:21.716088 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7ac00333-5311-426c-be06-9f706f0dcded req-960440f0-07c0-4c33-9946-4e547cce386a tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4113319 Nov 08 04:14:21.742158 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:20Z', 'revision_number': 3, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:21.807782 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Checking router: 8aa2c265-b728-4ac3-97de-f276d80d2037 for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:14:21.808130 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Updating router 8aa2c265-b728-4ac3-97de-f276d80d2037 port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 binding host dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:14:21.833504 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-bd0fc127-b466-4302-9737-9401d02c294e service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=64b004cc-acbd-488d-8f5d-2b3d5f02a667 HTTP/1.1" status: 200 len: 217 time: 0.1118889 Nov 08 04:14:21.837727 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d287e5-3a1c-459b-9f12-ba56770f11a8 None None] Pushing event updated for resources: {'Port': ['ID=b32ebd58-f404-4758-8887-7264a2e490fc,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:21.853921 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:21.899953 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-0715aa53-b466-4108-9a79-9eb66b1f850b None None] Provisioning complete for port b32ebd58-f404-4758-8887-7264a2e490fc triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:21.900455 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-0715aa53-b466-4108-9a79-9eb66b1f850b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.029790 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.051667 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96b1fda-9e80-408f-be75-3c5cd75fc219 req-4c49d1ba-c84d-4721-b79c-632bab2ca231 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:22.055146 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f96b1fda-9e80-408f-be75-3c5cd75fc219 req-4c49d1ba-c84d-4721-b79c-632bab2ca231 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 944 time: 0.2097623 Nov 08 04:14:22.086317 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-4e355a55-e7d1-4bf5-a676-f7429c216562 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:22.087680 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-4e355a55-e7d1-4bf5-a676-f7429c216562 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=8fce9f14-c9c6-47d9-9ea8-c6a5dedd5ca7 HTTP/1.1" status: 200 len: 848 time: 0.2199130 Nov 08 04:14:22.098134 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efe0cce-d9f4-4847-a375-cb6294b2616b req-91db1fdb-5c9b-49b6-9c42-b9f64a32daec tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:22.102412 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5efe0cce-d9f4-4847-a375-cb6294b2616b req-91db1fdb-5c9b-49b6-9c42-b9f64a32daec tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.2284231 Nov 08 04:14:22.144867 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f96b1fda-9e80-408f-be75-3c5cd75fc219 req-4291f2aa-88ef-4758-a5ad-76805a50d881 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0835831 Nov 08 04:14:22.147282 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Publish callbacks [] for port, precommit_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.170683 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5efe0cce-d9f4-4847-a375-cb6294b2616b req-ab6fe7d8-4d13-46ce-96b9-63deccc546d4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0591738 Nov 08 04:14:22.224976 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-4ff349c0-28f3-4592-b825-0e5ba0fb3c98 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0342975 Nov 08 04:14:22.239425 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.282423 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Allocated IP 172.20.0.1 (16cbde97-55ea-47f6-bd55-cf46e7c41a49/5926063e-8f31-4623-9cfc-4a0b577bdb41/4bdbd0d3-4329-4622-9ed1-490362f49e30) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:14:22.339314 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Pushing event updated for resources: {'Port': ['ID=38a2e2c4-b937-4b0b-b49d-6dbbc4e31925,revision_number=2']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:22.348711 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-c01b79c5-e866-4e7c-8953-6485f585b2c6 service neutron] 10.222.0.16 "GET /v2.0/networks/a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1123085 Nov 08 04:14:22.349723 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Attempting to bind port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:14:22.350105 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Attempting to bind port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:14:22.350462 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Attempting to bind port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 on network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:14:22.354646 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.355024 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.355360 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.357668 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.357668 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.357668 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.358724 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.359077 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.360587 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.360925 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.361250 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.362631 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:22.364819 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-3e37d817-1374-443f-99d8-51ade29bc2b3 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:22.366369 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-3e37d817-1374-443f-99d8-51ade29bc2b3 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 946 time: 0.1513450 Nov 08 04:14:22.370644 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 14, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:14:22.371242 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101667) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:14:22.371826 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.372367 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Bound using segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:14:22.373730 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Bound port: 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:14:22.374296 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.378425 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d0f98c-d33f-4073-b59c-8b2d4dae7ade req-60a0d199-e1b8-42ee-9f9a-445d5a2c56ea tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:22.380043 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7d0f98c-d33f-4073-b59c-8b2d4dae7ade req-60a0d199-e1b8-42ee-9f9a-445d5a2c56ea tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 944 time: 0.1576967 Nov 08 04:14:22.464720 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] For port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101667) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:14:22.469805 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] For port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=38a2e2c4-b937-4b0b-b49d-6dbbc4e31925,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101667) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:14:22.490945 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7d0f98c-d33f-4073-b59c-8b2d4dae7ade req-72c25097-36b2-4f3d-9e1d-e976f8446034 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1010966 Nov 08 04:14:22.507831 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-add65ff4-1128-4287-bbbe-a032cd22f111 req-1fc21be1-28a3-4b2c-bd01-a25d70ddfdc3 service neutron] 10.222.0.16 "GET /v2.0/networks/a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1493392 Nov 08 04:14:22.516969 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device e6483e56-c377-4575-bd34-b26a5c2bf382 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:22.554106 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.587522 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port e6483e56-c377-4575-bd34-b26a5c2bf382 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:22.588140 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.588614 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.637000 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-831ff80d-5481-4d9b-8281-b2559b600dca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Deleting port dc646599-8d18-41a0-9c3c-c4891c0f0c7c {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:14:22.637388 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-831ff80d-5481-4d9b-8281-b2559b600dca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.640167 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:14:22.640796 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:14:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:22.708709 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.744309 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:22.747819 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7db54e1-3d7c-4914-96dd-d7b0d7bb2255" -d '{"events": [{"server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "name": "network-vif-plugged", "status": "completed", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:22.755198 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-831ff80d-5481-4d9b-8281-b2559b600dca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] For port dc646599-8d18-41a0-9c3c-c4891c0f0c7c, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:22.755198 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-831ff80d-5481-4d9b-8281-b2559b600dca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.762045 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f1b994-30eb-4654-848f-107828ad1b88 None None] Pushing event updated for resources: {'Port': ['ID=38a2e2c4-b937-4b0b-b49d-6dbbc4e31925,revision_number=3']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:22.775203 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-831ff80d-5481-4d9b-8281-b2559b600dca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Calling delete_port for dc646599-8d18-41a0-9c3c-c4891c0f0c7c owned by compute:nova {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:14:22.800807 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:22.807927 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42414ac2-8ce8-4a15-8fc8-c4db007099d5 x-openstack-request-id: req-42414ac2-8ce8-4a15-8fc8-c4db007099d5 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:22.808207 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "name": "network-vif-plugged", "status": "completed", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:22.808461 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-42414ac2-8ce8-4a15-8fc8-c4db007099d5 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:22.808863 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'code': 200} Nov 08 04:14:22.822098 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:14:22.865524 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.886235 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:22.886926 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a55af80d-2d88-4247-b124-4ceee5a59ceb req-b8f253f3-9f3a-48b3-9cdb-a4bbda67782b tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:22.887557 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a55af80d-2d88-4247-b124-4ceee5a59ceb req-b8f253f3-9f3a-48b3-9cdb-a4bbda67782b tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 946 time: 0.0732772 Nov 08 04:14:22.949682 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=7']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:22.956538 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Pushing event updated for resources: {'Port': ['ID=4bdbd0d3-4329-4622-9ed1-490362f49e30,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:22.968812 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:14:22.974047 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:22.974163 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead467cb-2f40-4e9f-bfd3-1889ffa429d8 req-a596d444-d2eb-4b14-9b06-43e4c8fb79ce tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:22.974727 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:14:22.975565 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ead467cb-2f40-4e9f-bfd3-1889ffa429d8 req-a596d444-d2eb-4b14-9b06-43e4c8fb79ce tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1111472 Nov 08 04:14:22.994446 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a55af80d-2d88-4247-b124-4ceee5a59ceb req-6f47a174-e064-4f51-83d4-23ad080abe62 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869253 Nov 08 04:14:23.076495 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-703278'] for router_interface, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:23.115501 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:20Z', 'revision_number': 3, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:23.144676 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ead467cb-2f40-4e9f-bfd3-1889ffa429d8 req-2ab22e9b-9c17-4053-b297-d042057e6426 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1561599 Nov 08 04:14:23.176850 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c13c6da-147d-4be2-b7a8-f24e1f1cf55c None None] The sync data for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi is: [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:20Z', 'revision_number': 3, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:14:23.187483 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device b32ebd58-f404-4758-8887-7264a2e490fc up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:23.261615 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-831ff80d-5481-4d9b-8281-b2559b600dca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:23.312329 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['f790fbae-e681-4e01-b1a4-67513d491300', '946fbfcb-ea3d-434f-9d42-bd6883f13e5d', 'bee02b60-a424-4b49-9ecf-7f67857479a0', 'dc646599-8d18-41a0-9c3c-c4891c0f0c7c'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:14:23.339876 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-831ff80d-5481-4d9b-8281-b2559b600dca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Pushing event deleted for resources: {'Port': ['ID=dc646599-8d18-41a0-9c3c-c4891c0f0c7c,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:23.387206 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port b32ebd58-f404-4758-8887-7264a2e490fc triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:23.387679 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:23.451227 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe47b679-65c5-4148-9bab-d610c9f242b1 req-ff23df6d-0a7b-4a8f-9322-806cac119c62 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:23.454257 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fe47b679-65c5-4148-9bab-d610c9f242b1 req-ff23df6d-0a7b-4a8f-9322-806cac119c62 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1720204 Nov 08 04:14:23.460460 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-831ff80d-5481-4d9b-8281-b2559b600dca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] No DVR routers for this DVR port dc646599-8d18-41a0-9c3c-c4891c0f0c7c on host hv-cinder-78364 {{(pid=101664) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:14:23.461882 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:23.465807 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-831ff80d-5481-4d9b-8281-b2559b600dca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:23.469488 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-0057ddc3-6dad-4d3e-93d7-0f706fae8e4c req-831ff80d-5481-4d9b-8281-b2559b600dca tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "DELETE /v2.0/ports/dc646599-8d18-41a0-9c3c-c4891c0f0c7c HTTP/1.1" status: 204 len: 173 time: 1.0749428 Nov 08 04:14:23.469979 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '81fe6aff-1d2b-4fb2-9774-590ad1d532f1', 'name': 'network-vif-deleted', 'tag': 'dc646599-8d18-41a0-9c3c-c4891c0f0c7c'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:23.472607 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5a4abcbf-8a07-4a04-af0f-b6da50cd4dbe" -d '{"events": [{"server_uuid": "81fe6aff-1d2b-4fb2-9774-590ad1d532f1", "name": "network-vif-deleted", "tag": "dc646599-8d18-41a0-9c3c-c4891c0f0c7c"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:23.502742 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-472d0e31-3967-4295-ae1a-b12ef827eac4 None None] Provisioning complete for port 4bdbd0d3-4329-4622-9ed1-490362f49e30 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:23.503249 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-472d0e31-3967-4295-ae1a-b12ef827eac4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:23.504138 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-319a0161-6d2d-45d5-a65e-a27f106c698e req-13dceb5e-1c4e-42a7-a722-9dd9468d7ec5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:23.508106 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-319a0161-6d2d-45d5-a65e-a27f106c698e req-13dceb5e-1c4e-42a7-a722-9dd9468d7ec5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1677308 Nov 08 04:14:23.545849 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-472d0e31-3967-4295-ae1a-b12ef827eac4 None None] Port 4bdbd0d3-4329-4622-9ed1-490362f49e30 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:14:23.736578 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-319a0161-6d2d-45d5-a65e-a27f106c698e req-41e00a18-a5e3-48a1-9746-eab1eab3e7b6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2031112 Nov 08 04:14:23.835270 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:23.843266 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fe47b679-65c5-4148-9bab-d610c9f242b1 req-8b336df7-c39a-49d2-85a5-d6218cedd64f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3334920 Nov 08 04:14:23.916956 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:24.011131 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-707a55bf-cc86-4453-b1d7-35ad2cee2557 x-openstack-request-id: req-707a55bf-cc86-4453-b1d7-35ad2cee2557 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:24.011729 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "81fe6aff-1d2b-4fb2-9774-590ad1d532f1", "name": "network-vif-deleted", "tag": "dc646599-8d18-41a0-9c3c-c4891c0f0c7c", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:24.012625 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-707a55bf-cc86-4453-b1d7-35ad2cee2557 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:24.014298 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '81fe6aff-1d2b-4fb2-9774-590ad1d532f1', 'name': 'network-vif-deleted', 'tag': 'dc646599-8d18-41a0-9c3c-c4891c0f0c7c', 'status': 'completed', 'code': 200} Nov 08 04:14:24.125685 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfe144ee-61c6-4318-b3ca-a477a411f26e req-a3beba00-7d51-42a7-9e95-9a21a0fe680f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:24.138061 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cfe144ee-61c6-4318-b3ca-a477a411f26e req-a3beba00-7d51-42a7-9e95-9a21a0fe680f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 944 time: 0.1405895 Nov 08 04:14:24.159480 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Pushing event updated for resources: {'Port': ['ID=4bdbd0d3-4329-4622-9ed1-490362f49e30,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:24.164276 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530987', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-703418'] for router_interface, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:24.179360 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-261c6d9c-bb8d-418c-bb93-c7c9475bc128 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1635551 Nov 08 04:14:24.233148 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-750aff2f-f3bd-43fd-bb7f-8a60f6994070 req-1512526a-54bb-45cf-a0af-b2719cb6a119 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=81fe6aff-1d2b-4fb2-9774-590ad1d532f1 HTTP/1.1" status: 200 len: 210 time: 0.0405393 Nov 08 04:14:24.259692 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:24.285838 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cfe144ee-61c6-4318-b3ca-a477a411f26e req-cecffe09-996d-4f35-9b23-3fe16b21e93c tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1430027 Nov 08 04:14:24.439906 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7233b610-86c9-40d6-9683-106f0f3aa3ed req-734f54a8-8948-42bc-a8c1-a5c9cfdea69c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:24.441478 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7233b610-86c9-40d6-9683-106f0f3aa3ed req-734f54a8-8948-42bc-a8c1-a5c9cfdea69c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0896533 Nov 08 04:14:24.547834 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7233b610-86c9-40d6-9683-106f0f3aa3ed req-97a9f81d-12ad-44fa-b155-7e56ed9f83c4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0960670 Nov 08 04:14:24.649789 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-63cd4f22-996e-46f5-a9b3-274f2b130ca0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:24.651711 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-63cd4f22-996e-46f5-a9b3-274f2b130ca0 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 1098 time: 0.4328914 Nov 08 04:14:24.671754 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:14:24.673309 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:24.877471 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-8d23dd32-38e6-4678-bd3c-ff2c9596de6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:24.880714 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-8d23dd32-38e6-4678-bd3c-ff2c9596de6a service neutron] 10.222.0.16 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 920 time: 0.2005992 Nov 08 04:14:24.958197 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-92df7cf9-2aaf-4ad2-997c-73dc018f6736 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 HTTP/1.1" status: 200 len: 217 time: 0.0455830 Nov 08 04:14:25.016818 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Router 8aa2c265-b728-4ac3-97de-f276d80d2037 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:14:25.055610 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-b421121f-deca-42e6-aa2c-ecaabd5b52fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:25.057218 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-b421121f-deca-42e6-aa2c-ecaabd5b52fc service neutron] 10.222.0.16 "GET /v2.0/subnets?id=900a12a5-1baa-47e1-8b64-245dc70bc9f2 HTTP/1.1" status: 200 len: 859 time: 0.1158142 Nov 08 04:14:25.126402 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-7ace1c3f-0204-4bf7-86ef-9704bf494dad None None] Provisioning complete for port 4bdbd0d3-4329-4622-9ed1-490362f49e30 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:25.127043 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7ace1c3f-0204-4bf7-86ef-9704bf494dad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:25.139331 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-2499e730-8049-46ce-bccd-58ac8e24c1bf service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0377052 Nov 08 04:14:25.146351 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4889def-28db-4823-b130-ce578daaddbf req-c003c1ad-665c-463b-879c-7a271212b2f2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:25.147974 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4889def-28db-4823-b130-ce578daaddbf req-c003c1ad-665c-463b-879c-7a271212b2f2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.2929330 Nov 08 04:14:25.224561 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-7ace1c3f-0204-4bf7-86ef-9704bf494dad None None] Port 4bdbd0d3-4329-4622-9ed1-490362f49e30 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:14:25.287342 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:25.304358 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f971beb9-6625-4893-9234-e0abc0ab9d49 req-a90829d5-e4be-4a0e-9442-2886b64d055c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:25.305923 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f971beb9-6625-4893-9234-e0abc0ab9d49 req-a90829d5-e4be-4a0e-9442-2886b64d055c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1156919 Nov 08 04:14:25.322600 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4889def-28db-4823-b130-ce578daaddbf req-0bfe6257-6e9a-4f68-8fd5-8cf8417f307b tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1610496 Nov 08 04:14:25.383698 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:25.384346 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:25.410994 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-49783a1f-472a-4dce-93ae-32ab976f0307 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2538726 Nov 08 04:14:25.470946 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f971beb9-6625-4893-9234-e0abc0ab9d49 req-b54b8124-c50f-474c-b63d-1c80fdf555a7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1426840 Nov 08 04:14:25.520627 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:14:25.534540 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-9a7c1b91-3ffb-4540-a2f7-10ad178d261e admin admin] 10.222.0.21 "PUT /v2.0/routers/8aa2c265-b728-4ac3-97de-f276d80d2037/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1530733 Nov 08 04:14:25.562540 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:25.576774 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-1ec16b26-bf6b-41c0-a6bb-ab6efbfc60e7 req-1134eb8a-547f-400f-b7c9-ca9a2dd4e76b service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1560099 Nov 08 04:14:25.618165 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50fde0d-fb06-4c05-929b-56ef453433b7 req-79a71597-2949-4d91-8755-3aa4c7ca274e tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:25.619759 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b50fde0d-fb06-4c05-929b-56ef453433b7 req-79a71597-2949-4d91-8755-3aa4c7ca274e tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 944 time: 0.1192145 Nov 08 04:14:25.654556 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=38a2e2c4-b937-4b0b-b49d-6dbbc4e31925,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:25.714229 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:25.742436 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b50fde0d-fb06-4c05-929b-56ef453433b7 req-4c16e09f-2bd9-4df6-8211-301ccbc0f683 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137524 Nov 08 04:14:25.827810 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bdf8d95-31dc-4832-be31-f432902d6914 req-2374d250-ba31-4644-b2de-ca7371810d0e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:25.836629 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3bdf8d95-31dc-4832-be31-f432902d6914 req-2374d250-ba31-4644-b2de-ca7371810d0e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1415386 Nov 08 04:14:25.838652 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=38a2e2c4-b937-4b0b-b49d-6dbbc4e31925,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:25.900908 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3bdf8d95-31dc-4832-be31-f432902d6914 req-0022d664-7ef9-46e3-8ea1-d5b4407c1f67 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0631254 Nov 08 04:14:25.955799 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54012) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:25.972109 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Sync routers for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:14:25.991008 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:14:25.991008 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:14:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:26.083991 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d4babedc-e7cd-465a-9f06-82eead4a5c74 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:26.139923 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:14:26.202218 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d4babedc-e7cd-465a-9f06-82eead4a5c74 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:26.284675 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d4babedc-e7cd-465a-9f06-82eead4a5c74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:26.334912 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-d4babedc-e7cd-465a-9f06-82eead4a5c74 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=1c97e626c88f47c692682bcdfb5d90eb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3774095 Nov 08 04:14:26.338463 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 54020) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:26.339808 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4babedc-e7cd-465a-9f06-82eead4a5c74 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64ff81e0-7823-485a-87e4-6c4572ec5cb1,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:26.406174 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 2, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:26.445423 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Checking router: 8aa2c265-b728-4ac3-97de-f276d80d2037 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:14:26.445791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Updating router 8aa2c265-b728-4ac3-97de-f276d80d2037 port 4bdbd0d3-4329-4622-9ed1-490362f49e30 binding host dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:14:26.466984 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d162309c-8400-49c1-be4b-e345e801f9fa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:26.478613 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:26.514504 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d162309c-8400-49c1-be4b-e345e801f9fa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:26.538822 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 64b004cc-acbd-488d-8f5d-2b3d5f02a667 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:14:26.555669 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device dc646599-8d18-41a0-9c3c-c4891c0f0c7c no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:14:26.603735 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559f02b1-6cfb-4993-9c45-a124c18220cc req-70d30f65-e48e-4f2a-8ba0-f63b7efde4ba tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:26.612476 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-559f02b1-6cfb-4993-9c45-a124c18220cc req-70d30f65-e48e-4f2a-8ba0-f63b7efde4ba tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1670945 Nov 08 04:14:26.655176 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: dc646599-8d18-41a0-9c3c-c4891c0f0c7c {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:14:26.655915 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device dc646599-8d18-41a0-9c3c-c4891c0f0c7c not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:14:26.713253 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0065cb1-81a6-4c2c-9ab7-77a9957a461c req-4deb1c84-5264-4054-8a63-a26cdd650037 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:26.714777 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e0065cb1-81a6-4c2c-9ab7-77a9957a461c req-4deb1c84-5264-4054-8a63-a26cdd650037 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0840077 Nov 08 04:14:26.747863 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54034) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:26.754328 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-837607712-network', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:26.769105 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-559f02b1-6cfb-4993-9c45-a124c18220cc req-e8401230-a2d9-4cfe-8c4b-14928b41bd98 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1368110 Nov 08 04:14:26.824185 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e0065cb1-81a6-4c2c-9ab7-77a9957a461c req-42d6a54c-10ef-4958-a701-1bbf45645674 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0634403 Nov 08 04:14:26.844616 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Made reservation on behalf of 304c339eba1f44e2a3de7346f1de0b29 for: {'network': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:14:26.847139 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:26.863882 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:26.887678 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d162309c-8400-49c1-be4b-e345e801f9fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:26.891906 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d162309c-8400-49c1-be4b-e345e801f9fa admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:26.893937 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-d162309c-8400-49c1-be4b-e345e801f9fa admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/64ff81e0-7823-485a-87e4-6c4572ec5cb1 HTTP/1.1" status: 204 len: 168 time: 0.5545173 Nov 08 04:14:26.926900 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d162309c-8400-49c1-be4b-e345e801f9fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64ff81e0-7823-485a-87e4-6c4572ec5cb1,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:26.955736 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd96f691-1221-4d13-bcb7-22f3395ffb3a req-3b8b3215-564e-4189-8ad1-ecff374491fb tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:26.958147 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd96f691-1221-4d13-bcb7-22f3395ffb3a req-3b8b3215-564e-4189-8ad1-ecff374491fb tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 944 time: 0.1040971 Nov 08 04:14:26.972934 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:14:27.034025 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 64b004cc-acbd-488d-8f5d-2b3d5f02a667, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=64b004cc-acbd-488d-8f5d-2b3d5f02a667,segment=NetworkSegment(352fab34-f426-4ea6-a0d5-2c5b84c3f901),segment_id=352fab34-f426-4ea6-a0d5-2c5b84c3f901)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:27.053007 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '64b004cc-acbd-488d-8f5d-2b3d5f02a667', 'network_id': 'a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7', 'port_id': '64b004cc-acbd-488d-8f5d-2b3d5f02a667', 'mac_address': 'fa:16:3e:9e:9d:01', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 173, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8fce9f14-c9c6-47d9-9ea8-c6a5dedd5ca7', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:14:27.060276 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd96f691-1221-4d13-bcb7-22f3395ffb3a req-27bbbc62-d79d-437f-a082-7c08544e4f5e tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850458 Nov 08 04:14:27.086126 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.204236 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.227265 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60972aef-9550-425d-a906-646120a5221a req-5f7169e2-93da-4a32-8411-73e2532b36f4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:27.237258 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-60972aef-9550-425d-a906-646120a5221a req-5f7169e2-93da-4a32-8411-73e2532b36f4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0870233 Nov 08 04:14:27.259644 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] vlan segment allocate from pool success with {'vlan_id': 182, 'physical_network': 'physnet1'} {{(pid=101664) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:14:27.286108 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.288207 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.segments_db [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Added segment 9aaa3351-d0b4-46e7-bff2-5b43e82306c5 of type vlan for network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 Nov 08 04:14:27.294736 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-60972aef-9550-425d-a906-646120a5221a req-83cfb3bc-2cfe-437f-9cdc-55dbb2924c37 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0564320 Nov 08 04:14:27.366710 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Publish callbacks [] for port, precommit_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.370262 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.375420 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:27.378256 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.401055 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=764024bd-c96e-4f01-a3d0-a3c3ff1e8311,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:27.417224 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 64b004cc-acbd-488d-8f5d-2b3d5f02a667 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:14:27.441768 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 64b004cc-acbd-488d-8f5d-2b3d5f02a667, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=64b004cc-acbd-488d-8f5d-2b3d5f02a667,segment=NetworkSegment(352fab34-f426-4ea6-a0d5-2c5b84c3f901),segment_id=352fab34-f426-4ea6-a0d5-2c5b84c3f901)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:27.483529 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:27.485131 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.513635 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.514812 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:27.515655 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.520139 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.554263 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d912a101-ccdb-435e-89ac-02b27b17b672 req-4d9adba4-c912-46a0-8a30-f2da16568689 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:27.564319 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d912a101-ccdb-435e-89ac-02b27b17b672 req-4d9adba4-c912-46a0-8a30-f2da16568689 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 945 time: 0.0864472 Nov 08 04:14:27.565084 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.606174 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.8566458 Nov 08 04:14:27.607293 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54048) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:27.636685 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af1a5e9-f207-45ba-80fe-42c521337f7c None None] Pushing event updated for resources: {'Port': ['ID=4bdbd0d3-4329-4622-9ed1-490362f49e30,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:27.652472 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d912a101-ccdb-435e-89ac-02b27b17b672 req-7d8421ac-02b9-4f98-9d30-81f76bbe7914 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869231 Nov 08 04:14:27.686244 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Request body: {'subnet': {'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-837607712-subnet', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:27.700850 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f42bf77d-54ff-4932-9fe8-874874d3c006 admin admin] Pushing event updated for resources: {'Network': ['ID=2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:27.736171 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:14:27.768110 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Attempting to bind port 4bdbd0d3-4329-4622-9ed1-490362f49e30 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:14:27.768474 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Attempting to bind port 4bdbd0d3-4329-4622-9ed1-490362f49e30 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:14:27.768831 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Attempting to bind port 4bdbd0d3-4329-4622-9ed1-490362f49e30 on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:14:27.786899 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 14, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:14:27.787404 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Checking segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:14:27.787803 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.788191 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Bound using segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:14:27.788700 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Bound port: 4bdbd0d3-4329-4622-9ed1-490362f49e30, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:14:27.789051 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.793195 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Made reservation on behalf of 304c339eba1f44e2a3de7346f1de0b29 for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:14:27.795787 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5043309'] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:27.951934 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-549c5268-7e60-4338-b6c8-7c8e95795d8b req-81d97e42-ac16-4d19-b941-876d6fe10daa tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:27.962896 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-549c5268-7e60-4338-b6c8-7c8e95795d8b req-81d97e42-ac16-4d19-b941-876d6fe10daa tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0792010 Nov 08 04:14:28.027557 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['64b004cc-acbd-488d-8f5d-2b3d5f02a667'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:14:28.067357 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-549c5268-7e60-4338-b6c8-7c8e95795d8b req-f11be151-5021-47af-a0e3-0c9c1df408db tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0983772 Nov 08 04:14:28.104998 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=64b004cc-acbd-488d-8f5d-2b3d5f02a667,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:28.126013 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06fb034c-9c85-42e4-9f39-a24ccf2d5432 req-b874c52f-722b-4a65-bc1d-b663c35fe91a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:28.128343 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06fb034c-9c85-42e4-9f39-a24ccf2d5432 req-b874c52f-722b-4a65-bc1d-b663c35fe91a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1439033 Nov 08 04:14:28.146711 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] For port 4bdbd0d3-4329-4622-9ed1-490362f49e30, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:14:28.170515 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] For port 4bdbd0d3-4329-4622-9ed1-490362f49e30, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=4bdbd0d3-4329-4622-9ed1-490362f49e30,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:14:28.182744 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-be411bf0-192d-46d6-8adb-fa3fb9096ed0 None None] Provisioning complete for port 4bdbd0d3-4329-4622-9ed1-490362f49e30 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:28.183287 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-be411bf0-192d-46d6-8adb-fa3fb9096ed0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:28.220195 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5120956', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5043607'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:28.229009 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06fb034c-9c85-42e4-9f39-a24ccf2d5432 req-9fd05b9d-564f-44a2-b07e-0c2a076e4128 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0926957 Nov 08 04:14:28.269332 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-be411bf0-192d-46d6-8adb-fa3fb9096ed0 None None] Port 4bdbd0d3-4329-4622-9ed1-490362f49e30 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:14:28.282857 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a9e6d3-5cd5-4dda-b2be-5ec8aaf3fa20 req-10b20be5-038e-4624-a9c3-1b4cbb30aa0e tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:28.287451 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:28.294504 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4a9e6d3-5cd5-4dda-b2be-5ec8aaf3fa20 req-10b20be5-038e-4624-a9c3-1b4cbb30aa0e tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 945 time: 0.0890803 Nov 08 04:14:28.299428 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d7135ca5-abad-42c8-9fca-b5f1575cea78,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:28.311717 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Checking segment: {'id': '9aaa3351-d0b4-46e7-bff2-5b43e82306c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:14:28.312006 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Network hostable DHCP agents. Network: 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:14:28.399237 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:14:28.441798 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4a9e6d3-5cd5-4dda-b2be-5ec8aaf3fa20 req-f9b11ddc-0a2b-4ba5-9637-0fd61ca1b59b tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1371789 Nov 08 04:14:28.467744 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:28.473619 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:28.474280 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:28.486599 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90a15401-45ea-4583-85cb-ed947709fc2b None None] Network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:14:28.494350 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:14:28.495624 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:14:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:28.522055 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c98ed0-a0fe-4c75-9a54-b6b72f93f6e9 req-62844a0a-bb8f-4e95-a21b-c8ca82231641 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:28.530797 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91c98ed0-a0fe-4c75-9a54-b6b72f93f6e9 req-62844a0a-bb8f-4e95-a21b-c8ca82231641 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1461918 Nov 08 04:14:28.577092 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-ad7aa757-9aa7-4533-9a22-717938504607 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.8976986 Nov 08 04:14:28.582028 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 54074) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:28.593269 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-837607712-router', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:28.632316 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af1a5e9-f207-45ba-80fe-42c521337f7c None None] Pushing event updated for resources: {'Port': ['ID=4bdbd0d3-4329-4622-9ed1-490362f49e30,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:28.662823 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91c98ed0-a0fe-4c75-9a54-b6b72f93f6e9 req-af63b173-047a-41ad-901d-5de8f91365d4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1252718 Nov 08 04:14:28.748092 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-701463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7538'] for router, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:28.749553 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-701603', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-688686', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-770197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7531'] for router, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:28.765404 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:14:28.887519 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:28.946179 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-cb0ed55e-3072-4ba9-98cd-c65a9ac050c3 None None] Provisioning complete for port 4bdbd0d3-4329-4622-9ed1-490362f49e30 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:28.946670 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cb0ed55e-3072-4ba9-98cd-c65a9ac050c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:29.033471 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50a3a8ff-c704-4d2a-9357-336bf40b5075 req-585e0cf9-28c5-4938-9571-beb9a80d1dd2 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:29.043404 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-50a3a8ff-c704-4d2a-9357-336bf40b5075 req-585e0cf9-28c5-4938-9571-beb9a80d1dd2 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 945 time: 0.1460204 Nov 08 04:14:29.125845 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:29.142282 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp69aa137b-4136-5a6b-bf5e-deeb8c067c65-2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9', 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'fixed_ips': [{'subnet_id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78'}]}} from dv-cinder-783643-4-iscsi. {{(pid=101666) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 04:14:29.143944 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:29.255394 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-50a3a8ff-c704-4d2a-9357-336bf40b5075 req-61f51884-4402-4e39-b6fd-1ce0e77733ea tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2128553 Nov 08 04:14:29.294963 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2dca852-01a9-4c9b-a122-3e8e034982f1 req-cdfb98d5-0632-4fe4-a82c-05c0b4fb948f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:29.294963 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e2dca852-01a9-4c9b-a122-3e8e034982f1 req-cdfb98d5-0632-4fe4-a82c-05c0b4fb948f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0939395 Nov 08 04:14:29.300554 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cb0ed55e-3072-4ba9-98cd-c65a9ac050c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:29.315696 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-8beca20e-c415-4782-aa7d-bef34be55570 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:29.325303 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-8beca20e-c415-4782-aa7d-bef34be55570 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 945 time: 0.1152527 Nov 08 04:14:29.395177 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:28Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:29.395738 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e2dca852-01a9-4c9b-a122-3e8e034982f1 req-0cd63078-7b74-4559-9c51-165ab0c294e7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1010950 Nov 08 04:14:29.436859 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4727cca-398d-49a3-a515-3f433bc0f7b6 None None] The sync data for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi is: [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:28Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:14:29.454857 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-cb0ed55e-3072-4ba9-98cd-c65a9ac050c3 None None] For port 4bdbd0d3-4329-4622-9ed1-490362f49e30, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=4bdbd0d3-4329-4622-9ed1-490362f49e30,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:29.484733 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-a7ac7222-c3e4-4b30-86cf-bd62d432f822 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Deleting port bee02b60-a424-4b49-9ecf-7f67857479a0 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:14:29.487464 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-a7ac7222-c3e4-4b30-86cf-bd62d432f822 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:29.487599 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.db_base_plugin_common [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Allocated IP 172.20.0.2 (2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9/d7135ca5-abad-42c8-9fca-b5f1575cea78/d0eab8ec-dcd7-4727-a451-ac703861b605) {{(pid=101666) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:14:29.649814 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-a7ac7222-c3e4-4b30-86cf-bd62d432f822 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] For port bee02b60-a424-4b49-9ecf-7f67857479a0, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=bee02b60-a424-4b49-9ecf-7f67857479a0,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:29.650190 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-a7ac7222-c3e4-4b30-86cf-bd62d432f822 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:29.664279 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cb0ed55e-3072-4ba9-98cd-c65a9ac050c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:29.671386 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-a7ac7222-c3e4-4b30-86cf-bd62d432f822 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Calling delete_port for bee02b60-a424-4b49-9ecf-7f67857479a0 owned by compute:nova {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:14:29.679198 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba1804c-c5a1-497a-b80c-5848c33f35c7 req-96938210-13c3-4b81-bacc-fee07a9557f6 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:29.691043 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ba1804c-c5a1-497a-b80c-5848c33f35c7 req-96938210-13c3-4b81-bacc-fee07a9557f6 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.2840281 Nov 08 04:14:29.694681 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:29.754267 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:29.799760 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-112f70fc-8f15-4c85-a751-3ab43664ea35 req-795fcb3e-2dae-472e-b960-15a088a1a540 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:29.804574 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-112f70fc-8f15-4c85-a751-3ab43664ea35 req-795fcb3e-2dae-472e-b960-15a088a1a540 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 945 time: 0.2568114 Nov 08 04:14:29.821142 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb0ed55e-3072-4ba9-98cd-c65a9ac050c3 None None] Pushing event updated for resources: {'Port': ['ID=4bdbd0d3-4329-4622-9ed1-490362f49e30,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:29.882614 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Publish callbacks [] for port, precommit_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:29.954773 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ba1804c-c5a1-497a-b80c-5848c33f35c7 req-d5a31354-3f72-4615-82a0-b8317b71807d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2492085 Nov 08 04:14:29.983458 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:30.022231 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-a7ac7222-c3e4-4b30-86cf-bd62d432f822 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:30.035417 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-112f70fc-8f15-4c85-a751-3ab43664ea35 req-1548a222-06c0-4546-9863-c581eb910171 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2250612 Nov 08 04:14:30.078642 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Allocated IP 172.27.2.49 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/c08b9ee1-e152-4ab8-a625-655bb485f35b) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:14:30.079599 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ac7222-c3e4-4b30-86cf-bd62d432f822 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Pushing event deleted for resources: {'Port': ['ID=bee02b60-a424-4b49-9ecf-7f67857479a0,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:30.146036 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-a7ac7222-c3e4-4b30-86cf-bd62d432f822 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] No DVR routers for this DVR port bee02b60-a424-4b49-9ecf-7f67857479a0 on host hv-cinder-78364 {{(pid=101664) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:14:30.157845 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-a7ac7222-c3e4-4b30-86cf-bd62d432f822 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:30.162352 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-75d1a7c5-38d8-4b71-bb46-829c09dbfa90 req-a7ac7222-c3e4-4b30-86cf-bd62d432f822 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "DELETE /v2.0/ports/bee02b60-a424-4b49-9ecf-7f67857479a0 HTTP/1.1" status: 204 len: 173 time: 0.8300591 Nov 08 04:14:30.162906 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2ad19102-59e1-43e1-97ee-7c10d6ac69c5', 'name': 'network-vif-deleted', 'tag': 'bee02b60-a424-4b49-9ecf-7f67857479a0'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:30.166160 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46132c7c-e949-49a4-a07c-da337a6e5755" -d '{"events": [{"server_uuid": "2ad19102-59e1-43e1-97ee-7c10d6ac69c5", "name": "network-vif-deleted", "tag": "bee02b60-a424-4b49-9ecf-7f67857479a0"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:30.286413 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6f24268c-6ea7-4a16-b477-5cdccc25b340 x-openstack-request-id: req-6f24268c-6ea7-4a16-b477-5cdccc25b340 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:30.286744 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2ad19102-59e1-43e1-97ee-7c10d6ac69c5", "name": "network-vif-deleted", "tag": "bee02b60-a424-4b49-9ecf-7f67857479a0", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:30.287000 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-6f24268c-6ea7-4a16-b477-5cdccc25b340 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:30.287406 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2ad19102-59e1-43e1-97ee-7c10d6ac69c5', 'name': 'network-vif-deleted', 'tag': 'bee02b60-a424-4b49-9ecf-7f67857479a0', 'status': 'completed', 'code': 200} Nov 08 04:14:30.379717 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['f790fbae-e681-4e01-b1a4-67513d491300', '946fbfcb-ea3d-434f-9d42-bd6883f13e5d', 'bee02b60-a424-4b49-9ecf-7f67857479a0'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:14:30.427196 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Pushing event updated for resources: {'Port': ['ID=d0eab8ec-dcd7-4727-a451-ac703861b605,revision_number=1']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:30.472388 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 is already hosted by enough agents. {{(pid=101666) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:14:30.479829 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.base_scheduler [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Resources bound (agent type, host, resource id): {{(pid=101666) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:30.482396 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Received port after_create {{(pid=101666) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:14:30.569537 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 64b004cc-acbd-488d-8f5d-2b3d5f02a667 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:30.613747 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fd8e47f2-f08a-4fa8-bfc4-ca341e6ff443 req-9f58f96a-cfe5-4eaa-b5c3-d65211735293 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 210 time: 0.0766275 Nov 08 04:14:30.695179 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461492c7-d21b-4a05-acea-73a2f0675617 req-f86e00d7-c2ba-4309-a74e-b6869293a577 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:30.705410 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Attempting to bind port d0eab8ec-dcd7-4727-a451-ac703861b605 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:14:30.706059 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-461492c7-d21b-4a05-acea-73a2f0675617 req-f86e00d7-c2ba-4309-a74e-b6869293a577 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.6117322 Nov 08 04:14:30.711130 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Attempting to bind port d0eab8ec-dcd7-4727-a451-ac703861b605 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9aaa3351-d0b4-46e7-bff2-5b43e82306c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:14:30.711130 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Attempting to bind port d0eab8ec-dcd7-4727-a451-ac703861b605 on network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:14:30.721401 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 14, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:14:30.722791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Checking segment: {'id': '9aaa3351-d0b4-46e7-bff2-5b43e82306c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:14:30.723513 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:30.724617 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Bound using segment: {'id': '9aaa3351-d0b4-46e7-bff2-5b43e82306c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:14:30.725760 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Bound port: d0eab8ec-dcd7-4727-a451-ac703861b605, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9aaa3351-d0b4-46e7-bff2-5b43e82306c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:14:30.726430 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:30.778634 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:30.849327 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-461492c7-d21b-4a05-acea-73a2f0675617 req-f18b39e6-3752-42b9-87f6-c6ee7c3dc2e8 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1424270 Nov 08 04:14:30.896835 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af82c43-a69d-47bd-a4e5-88ca4fbeea7a req-cf37492c-cacc-4ed3-b5c4-8ce34470f3c1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:30.897139 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3af82c43-a69d-47bd-a4e5-88ca4fbeea7a req-cf37492c-cacc-4ed3-b5c4-8ce34470f3c1 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1381309 Nov 08 04:14:30.914516 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 64b004cc-acbd-488d-8f5d-2b3d5f02a667 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:14:30.928241 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 64b004cc-acbd-488d-8f5d-2b3d5f02a667 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:30.928615 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:30.969604 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:30.981514 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] For port d0eab8ec-dcd7-4727-a451-ac703861b605, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:14:30.985366 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3af82c43-a69d-47bd-a4e5-88ca4fbeea7a req-7b9b6c4f-e9dd-4167-ad37-b41633dac862 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0871942 Nov 08 04:14:31.035143 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] For port d0eab8ec-dcd7-4727-a451-ac703861b605, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=d0eab8ec-dcd7-4727-a451-ac703861b605,segment=NetworkSegment(9aaa3351-d0b4-46e7-bff2-5b43e82306c5),segment_id=9aaa3351-d0b4-46e7-bff2-5b43e82306c5)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:14:31.046446 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:14:31.055427 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:31.068876 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:14:31.109277 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:31.112364 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Pushing event updated for resources: {'Port': ['ID=c08b9ee1-e152-4ab8-a625-655bb485f35b,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:31.214764 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7207829e-b4e5-4d69-a754-8d4ce15c079c None None] Pushing event updated for resources: {'Port': ['ID=d0eab8ec-dcd7-4727-a451-ac703861b605,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:31.335834 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2033563b-59a2-4f5d-9965-1913539a59a5 req-9d7397f8-c90c-42c2-977f-4575696ae052 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:31.344595 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2033563b-59a2-4f5d-9965-1913539a59a5 req-9d7397f8-c90c-42c2-977f-4575696ae052 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.2791138 Nov 08 04:14:31.366851 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 4bdbd0d3-4329-4622-9ed1-490362f49e30 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:31.417417 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:31.507115 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd17b73e9-e1f4-4e15-97e0-4239d5edc964', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '64b004cc-acbd-488d-8f5d-2b3d5f02a667'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:31.509522 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ceb9d435-5d3f-496a-95d4-72275810f616" -d '{"events": [{"server_uuid": "d17b73e9-e1f4-4e15-97e0-4239d5edc964", "name": "network-vif-plugged", "status": "completed", "tag": "64b004cc-acbd-488d-8f5d-2b3d5f02a667"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:31.519136 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2f414c-2766-4e78-b7bc-7600326f6c8b req-048dcaaf-140e-47f2-a192-1264700d1acb tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:31.529628 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fa2f414c-2766-4e78-b7bc-7600326f6c8b req-048dcaaf-140e-47f2-a192-1264700d1acb tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 945 time: 0.2701976 Nov 08 04:14:31.548044 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 64b004cc-acbd-488d-8f5d-2b3d5f02a667, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=64b004cc-acbd-488d-8f5d-2b3d5f02a667,segment=NetworkSegment(352fab34-f426-4ea6-a0d5-2c5b84c3f901),segment_id=352fab34-f426-4ea6-a0d5-2c5b84c3f901)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:31.550049 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2033563b-59a2-4f5d-9965-1913539a59a5 req-056cf3d4-15d7-46f5-9fd0-5bbd5e053d69 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2032845 Nov 08 04:14:31.601096 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 4bdbd0d3-4329-4622-9ed1-490362f49e30 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:31.601712 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:31.672750 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b44693f2-717c-41b0-bc9f-d44f000b0552 x-openstack-request-id: req-b44693f2-717c-41b0-bc9f-d44f000b0552 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:31.679156 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d17b73e9-e1f4-4e15-97e0-4239d5edc964", "name": "network-vif-plugged", "status": "completed", "tag": "64b004cc-acbd-488d-8f5d-2b3d5f02a667", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:31.679156 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-b44693f2-717c-41b0-bc9f-d44f000b0552 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:31.679156 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd17b73e9-e1f4-4e15-97e0-4239d5edc964', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '64b004cc-acbd-488d-8f5d-2b3d5f02a667', 'code': 200} Nov 08 04:14:31.679156 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:31.735344 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fa2f414c-2766-4e78-b7bc-7600326f6c8b req-ec204ddd-c524-49ae-a713-656ea238254e tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2026250 Nov 08 04:14:31.880501 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=64b004cc-acbd-488d-8f5d-2b3d5f02a667,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:31.935951 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8a554c72-f9f8-4a2f-b2bd-f9b59b7addfb req-03002924-6e4a-4efd-8803-b006a39781fb tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=2ad19102-59e1-43e1-97ee-7c10d6ac69c5 HTTP/1.1" status: 200 len: 210 time: 0.1123216 Nov 08 04:14:31.970474 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:32.186291 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca55ed6b-9c14-485c-8555-8d8dcb86030e req-a614120a-0e95-44e5-ab7d-af3946ccb119 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:32.189721 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ca55ed6b-9c14-485c-8555-8d8dcb86030e req-a614120a-0e95-44e5-ab7d-af3946ccb119 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 1099 time: 0.0766180 Nov 08 04:14:32.227762 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0032d4d-b342-4312-953d-0346b0b1e78b req-8b8f1213-da36-4a9b-8ead-724a9e5512ce tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:32.229233 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a0032d4d-b342-4312-953d-0346b0b1e78b req-8b8f1213-da36-4a9b-8ead-724a9e5512ce tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1995459 Nov 08 04:14:32.251592 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ca55ed6b-9c14-485c-8555-8d8dcb86030e req-c3f9a0a0-90f0-4f8b-81de-9afee7682e30 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543284 Nov 08 04:14:32.290943 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-378dca33-25b1-40a7-891a-0bdbd3f6a32f req-76b2cf66-f90d-4f73-a505-ef92d5c25359 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:32.292528 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-378dca33-25b1-40a7-891a-0bdbd3f6a32f req-76b2cf66-f90d-4f73-a505-ef92d5c25359 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1328814 Nov 08 04:14:32.392199 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a0032d4d-b342-4312-953d-0346b0b1e78b req-d8fc4cd5-879b-4898-b85d-5d49fce471e7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1543860 Nov 08 04:14:32.484474 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-378dca33-25b1-40a7-891a-0bdbd3f6a32f req-749c65dc-0c41-4496-8d91-72cefbc1b331 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1497746 Nov 08 04:14:32.493095 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-701612', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891'] for router, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:32.702627 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90465c21-2293-4ab4-8fed-d6f5f96c26ce req-fa16adc9-1006-4d21-ad3f-2aac49ee4306 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:32.710290 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-90465c21-2293-4ab4-8fed-d6f5f96c26ce req-fa16adc9-1006-4d21-ad3f-2aac49ee4306 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0638189 Nov 08 04:14:32.755545 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e4104aa-8edf-4ef8-bf4c-343e99e6b780 None None] Network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:14:32.770351 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-90465c21-2293-4ab4-8fed-d6f5f96c26ce req-6ad61156-ce5f-4071-b79c-923e1b6f93e7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558071 Nov 08 04:14:32.773489 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Router dbf47dba-2137-4db8-a25b-98db4696ddc4 is scheduled to L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 with binding_index 1 {{(pid=101665) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 04:14:32.877737 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-69d085e7-7448-43d8-8214-d189cc0ab944 None None] Provisioning complete for port d0eab8ec-dcd7-4727-a451-ac703861b605 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:32.878145 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-69d085e7-7448-43d8-8214-d189cc0ab944 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:32.983790 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:14:32.995548 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Sync routers for ids ['dbf47dba-2137-4db8-a25b-98db4696ddc4'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:14:33.007196 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-223ebfc9-e880-43cf-9144-71854c6e6b9b req-c61191fa-49bd-4e3e-9bb3-96b0f511e0a7 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:33.008752 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-223ebfc9-e880-43cf-9144-71854c6e6b9b req-c61191fa-49bd-4e3e-9bb3-96b0f511e0a7 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 946 time: 0.1544802 Nov 08 04:14:33.016948 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Routers {'dbf47dba-2137-4db8-a25b-98db4696ddc4'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:14:33.021693 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:14:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['dbf47dba-2137-4db8-a25b-98db4696ddc4'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:33.043282 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-69d085e7-7448-43d8-8214-d189cc0ab944 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:33.091964 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-69d085e7-7448-43d8-8214-d189cc0ab944 None None] For port d0eab8ec-dcd7-4727-a451-ac703861b605, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=d0eab8ec-dcd7-4727-a451-ac703861b605,segment=NetworkSegment(9aaa3351-d0b4-46e7-bff2-5b43e82306c5),segment_id=9aaa3351-d0b4-46e7-bff2-5b43e82306c5)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:33.115056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-223ebfc9-e880-43cf-9144-71854c6e6b9b req-ef85f573-25c8-42a3-88e5-fac75092bec0 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0919473 Nov 08 04:14:33.123282 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] Publish callbacks [] for router, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:33.126259 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-de450ad6-9ba8-4c91-ae18-7fd7ce95c5a4 admin admin] 10.222.0.21 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 4.5419004 Nov 08 04:14:33.127648 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54138) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:33.184585 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-69d085e7-7448-43d8-8214-d189cc0ab944 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:33.220474 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device d0eab8ec-dcd7-4727-a451-ac703861b605 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:33.310414 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69d085e7-7448-43d8-8214-d189cc0ab944 None None] Pushing event updated for resources: {'Port': ['ID=d0eab8ec-dcd7-4727-a451-ac703861b605,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:33.336307 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port d0eab8ec-dcd7-4727-a451-ac703861b605 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:33.340629 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:33.349756 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Set router dbf47dba-2137-4db8-a25b-98db4696ddc4 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:14:33.431627 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-0ca5f72c-bdd4-4459-a9d9-ebc8ba8340ad None None] Provisioning complete for port d0eab8ec-dcd7-4727-a451-ac703861b605 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:33.432001 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-0ca5f72c-bdd4-4459-a9d9-ebc8ba8340ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:33.687915 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ecebd0-e097-4225-b185-b584460f3ef2 req-f3ffcd74-44af-4cae-8c2b-9cdc9a142717 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:33.690267 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31ecebd0-e097-4225-b185-b584460f3ef2 req-f3ffcd74-44af-4cae-8c2b-9cdc9a142717 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1755841 Nov 08 04:14:33.710960 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'name': 'tempest-TestVolumeBootPattern-837607712-router', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49'}], 'enable_snat': True}, 'gw_port_id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:28Z', 'updated_at': '2021-11-08T04:14:31Z', 'revision_number': 3, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'gw_port': {'id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:c1:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 349, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:29Z', 'updated_at': '2021-11-08T04:14:30Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:33.720914 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3557c27b-6821-4412-9e62-60a5cb4bdf36 req-252ef10d-dfae-466c-afe2-2ffad9d632bd tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:33.722709 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3557c27b-6821-4412-9e62-60a5cb4bdf36 req-252ef10d-dfae-466c-afe2-2ffad9d632bd tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 945 time: 0.1238148 Nov 08 04:14:33.751267 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Checking router: dbf47dba-2137-4db8-a25b-98db4696ddc4 for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:14:33.751627 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Updating router dbf47dba-2137-4db8-a25b-98db4696ddc4 port c08b9ee1-e152-4ab8-a625-655bb485f35b binding host dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:14:33.778580 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:33.779731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31ecebd0-e097-4225-b185-b584460f3ef2 req-2e907cf6-fdec-42cb-938c-b32666b81737 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0817354 Nov 08 04:14:33.810687 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:33.855904 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3557c27b-6821-4412-9e62-60a5cb4bdf36 req-a9f99da7-8d0a-408f-a85b-a5f1978381b0 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1233346 Nov 08 04:14:33.946666 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd366488-b037-4026-8fc7-861889abd40b req-869e8e8c-5575-41c7-9e22-0f6bdb5b7f5c tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:33.958988 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fd366488-b037-4026-8fc7-861889abd40b req-869e8e8c-5575-41c7-9e22-0f6bdb5b7f5c tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0996606 Nov 08 04:14:34.057741 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fd366488-b037-4026-8fc7-861889abd40b req-49f82af7-828d-4140-b028-b0dc07d6b581 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0914004 Nov 08 04:14:34.072022 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e148765-8e09-44f5-81c3-32b109ad554e req-5f7da92f-030a-4456-bfc0-f0d18a666db9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:34.080628 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Allocated IP 172.20.0.1 (2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9/d7135ca5-abad-42c8-9fca-b5f1575cea78/0cd56535-8b05-4a35-bc64-4224a5f89118) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:14:34.085769 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0e148765-8e09-44f5-81c3-32b109ad554e req-5f7da92f-030a-4456-bfc0-f0d18a666db9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1183958 Nov 08 04:14:34.158222 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0e148765-8e09-44f5-81c3-32b109ad554e req-06cf7cd6-8086-47f8-878b-ebadbff8ce02 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0632083 Nov 08 04:14:34.189504 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Publish callbacks [] for port, precommit_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:34.248789 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:34.299991 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:34.303519 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f355dbde-61fc-4a7d-b4ee-a82456179cbe req-77c12b41-ba5d-4701-9fd7-3bfb8d4484e2 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:34.305268 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f355dbde-61fc-4a7d-b4ee-a82456179cbe req-77c12b41-ba5d-4701-9fd7-3bfb8d4484e2 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 946 time: 0.0562036 Nov 08 04:14:34.348470 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:34.363358 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f355dbde-61fc-4a7d-b4ee-a82456179cbe req-3396f695-9e6b-4291-838b-aa999ffcc106 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514960 Nov 08 04:14:34.365846 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Attempting to bind port c08b9ee1-e152-4ab8-a625-655bb485f35b on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:14:34.365846 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Attempting to bind port c08b9ee1-e152-4ab8-a625-655bb485f35b by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:14:34.366222 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Attempting to bind port c08b9ee1-e152-4ab8-a625-655bb485f35b on network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:14:34.380072 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81af1b73-e5f5-45b6-a496-7e747a5deabd None None] Pushing event updated for resources: {'Port': ['ID=c08b9ee1-e152-4ab8-a625-655bb485f35b,revision_number=2']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:34.385231 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 14, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:14:34.385595 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101667) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:14:34.385977 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:34.386362 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Bound using segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:14:34.386882 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Bound port: c08b9ee1-e152-4ab8-a625-655bb485f35b, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:14:34.387275 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:34.415070 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:14:34.418188 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:34.424353 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:14:34.426459 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Pushing event updated for resources: {'Port': ['ID=0cd56535-8b05-4a35-bc64-4224a5f89118,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:34.466038 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] For port c08b9ee1-e152-4ab8-a625-655bb485f35b, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101667) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:14:34.470299 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] For port c08b9ee1-e152-4ab8-a625-655bb485f35b, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=c08b9ee1-e152-4ab8-a625-655bb485f35b,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101667) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:14:34.475427 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.475991 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.476397 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.476800 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.477201 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.477643 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.478094 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.478642 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.478974 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.479400 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.479829 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.480257 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:34.487292 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-703278'] for router_interface, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:34.552123 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:34.687454 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-0d4d92c8-6922-417b-ac20-295293e8a6b4 None None] Provisioning complete for port 0cd56535-8b05-4a35-bc64-4224a5f89118 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:34.688453 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-0d4d92c8-6922-417b-ac20-295293e8a6b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:34.704666 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Routers {'dbf47dba-2137-4db8-a25b-98db4696ddc4'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:14:34.704666 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:14:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['dbf47dba-2137-4db8-a25b-98db4696ddc4'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:34.714519 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:34.741221 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-0d4d92c8-6922-417b-ac20-295293e8a6b4 None None] Port 0cd56535-8b05-4a35-bc64-4224a5f89118 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:14:34.774863 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81af1b73-e5f5-45b6-a496-7e747a5deabd None None] Pushing event updated for resources: {'Port': ['ID=c08b9ee1-e152-4ab8-a625-655bb485f35b,revision_number=3']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:34.936558 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] Set router dbf47dba-2137-4db8-a25b-98db4696ddc4 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:14:34.980035 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54dbe605-e4b3-45f0-8585-2825d50bdb8a req-574c5e25-edb1-4b56-96a5-cd6b3f96d497 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:34.994438 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-54dbe605-e4b3-45f0-8585-2825d50bdb8a req-574c5e25-edb1-4b56-96a5-cd6b3f96d497 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1168811 Nov 08 04:14:35.090811 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:35.106624 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device d0eab8ec-dcd7-4727-a451-ac703861b605 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:35.207125 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port d0eab8ec-dcd7-4727-a451-ac703861b605 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:35.207526 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:35.214703 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba613dcb-dd07-4644-b1ed-19fb3cf39607 req-1b230552-4aa6-43b9-8f24-3bd4060e11d2 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:35.216269 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ba613dcb-dd07-4644-b1ed-19fb3cf39607 req-1b230552-4aa6-43b9-8f24-3bd4060e11d2 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 945 time: 0.2194860 Nov 08 04:14:35.229141 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-54dbe605-e4b3-45f0-8585-2825d50bdb8a req-c2abd1bc-aa46-432a-b63f-0e4c1eac530a tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2308207 Nov 08 04:14:35.309713 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ba613dcb-dd07-4644-b1ed-19fb3cf39607 req-3374b1b3-dffa-4327-8d01-36448a5e300e tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798588 Nov 08 04:14:35.330461 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device bee02b60-a424-4b49-9ecf-7f67857479a0 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:14:35.343648 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'name': 'tempest-TestVolumeBootPattern-837607712-router', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49'}], 'enable_snat': True}, 'gw_port_id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:28Z', 'updated_at': '2021-11-08T04:14:34Z', 'revision_number': 4, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'gw_port': {'id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:c1:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 349, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:29Z', 'updated_at': '2021-11-08T04:14:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0cd56535-8b05-4a35-bc64-4224a5f89118', 'name': '', 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'mac_address': 'fa:16:3e:24:6c:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:33Z', 'updated_at': '2021-11-08T04:14:34Z', 'revision_number': 1, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'subnets': [{'id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:35.366066 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: bee02b60-a424-4b49-9ecf-7f67857479a0 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:14:35.366554 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device bee02b60-a424-4b49-9ecf-7f67857479a0 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:14:35.379484 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-374642d0-bfd7-4352-b72c-34e852fa3ad0 None None] The sync data for ids ['dbf47dba-2137-4db8-a25b-98db4696ddc4'] in dv-cinder-783643-4-iscsi is: [{'id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'name': 'tempest-TestVolumeBootPattern-837607712-router', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49'}], 'enable_snat': True}, 'gw_port_id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:28Z', 'updated_at': '2021-11-08T04:14:34Z', 'revision_number': 4, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'gw_port': {'id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:c1:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 349, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:29Z', 'updated_at': '2021-11-08T04:14:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0cd56535-8b05-4a35-bc64-4224a5f89118', 'name': '', 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'mac_address': 'fa:16:3e:24:6c:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:33Z', 'updated_at': '2021-11-08T04:14:34Z', 'revision_number': 1, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'subnets': [{'id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:14:35.390265 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4341ef25-c919-4dc0-95b1-0a680d5c446f req-8f7eb5ac-69d6-40a4-aa27-a3d6f1fa4846 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:35.392936 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4341ef25-c919-4dc0-95b1-0a680d5c446f req-8f7eb5ac-69d6-40a4-aa27-a3d6f1fa4846 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0757232 Nov 08 04:14:35.487064 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4341ef25-c919-4dc0-95b1-0a680d5c446f req-c7421cf9-49cc-4cd4-aeae-13acc294e961 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864573 Nov 08 04:14:35.497299 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08821abb-9fb3-429e-85a8-de0fab01db91 req-e5716fa0-b745-45ee-b863-e8d6f8b779df tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:35.497299 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-08821abb-9fb3-429e-85a8-de0fab01db91 req-e5716fa0-b745-45ee-b863-e8d6f8b779df tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0940897 Nov 08 04:14:35.588696 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-08821abb-9fb3-429e-85a8-de0fab01db91 req-2748c359-93b0-4ca1-a92c-8f31241447a1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0838134 Nov 08 04:14:35.597899 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c01b14-9c2b-43ab-8055-65af1db8662e req-f5a0cdb2-b27b-407c-82cb-a11c9fa7d4d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:35.606315 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-77c01b14-9c2b-43ab-8055-65af1db8662e req-f5a0cdb2-b27b-407c-82cb-a11c9fa7d4d2 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 1098 time: 0.0750508 Nov 08 04:14:35.640389 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e6e0fd9-b19c-468b-ae7b-2d05d91c85fd req-07893b1b-73af-4dd1-b8d0-c89d152feaf2 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:35.642038 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3e6e0fd9-b19c-468b-ae7b-2d05d91c85fd req-07893b1b-73af-4dd1-b8d0-c89d152feaf2 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 946 time: 0.0936060 Nov 08 04:14:35.673604 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-77c01b14-9c2b-43ab-8055-65af1db8662e req-1717cf5c-7a96-43b1-9738-b9dac5ed684f service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453165 Nov 08 04:14:35.687022 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:35.697310 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3e6e0fd9-b19c-468b-ae7b-2d05d91c85fd req-4aaa1747-1b00-4524-993e-53d7fbb1b8b6 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493064 Nov 08 04:14:35.759242 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Pushing event updated for resources: {'Port': ['ID=0cd56535-8b05-4a35-bc64-4224a5f89118,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:35.759242 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530987', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-703418'] for router_interface, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:35.879652 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:14:35.881026 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:14:36.044594 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Router dbf47dba-2137-4db8-a25b-98db4696ddc4 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:14:36.212385 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-78a5ec39-fa15-4ad7-91ba-2af014a1ba2e None None] Provisioning complete for port 0cd56535-8b05-4a35-bc64-4224a5f89118 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:36.213007 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-78a5ec39-fa15-4ad7-91ba-2af014a1ba2e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:36.250628 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:14:36.266469 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a7c98ac3-e276-42c2-a0e7-387816bf12b5 admin admin] 10.222.0.21 "PUT /v2.0/routers/dbf47dba-2137-4db8-a25b-98db4696ddc4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1369338 Nov 08 04:14:36.272467 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-78a5ec39-fa15-4ad7-91ba-2af014a1ba2e None None] Port 0cd56535-8b05-4a35-bc64-4224a5f89118 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:14:36.491087 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a3cd08-6cd0-4401-ac57-528e8c6b3aa7 req-07c983ac-1fa2-4a72-b2b0-859aa315d2f4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:36.499980 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b0a3cd08-6cd0-4401-ac57-528e8c6b3aa7 req-07c983ac-1fa2-4a72-b2b0-859aa315d2f4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1362329 Nov 08 04:14:36.527576 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05a97cb8-91bf-41ca-aaf2-2d9c78cf33a6 req-b5a1befa-faba-4d24-84b1-49f661bf8f6b tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:36.529051 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-05a97cb8-91bf-41ca-aaf2-2d9c78cf33a6 req-b5a1befa-faba-4d24-84b1-49f661bf8f6b tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 945 time: 0.1135466 Nov 08 04:14:36.612794 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b0a3cd08-6cd0-4401-ac57-528e8c6b3aa7 req-874c6210-20e8-4731-af22-2308db3b4ef8 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1134343 Nov 08 04:14:36.627335 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-05a97cb8-91bf-41ca-aaf2-2d9c78cf33a6 req-6884a66f-0717-4032-82ec-518620ecb10c tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0819674 Nov 08 04:14:36.774000 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2727b7-13c3-40cc-a3bc-93d3c27c1357 req-2b6b9eca-e1e9-4665-b4ab-7d394131134f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:36.782729 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be2727b7-13c3-40cc-a3bc-93d3c27c1357 req-2b6b9eca-e1e9-4665-b4ab-7d394131134f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0827422 Nov 08 04:14:36.892045 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be2727b7-13c3-40cc-a3bc-93d3c27c1357 req-a6ad648d-6105-46d1-a29f-ccc39b689d63 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1047778 Nov 08 04:14:37.103300 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d58c35-906e-4e53-a252-0fcbedd388b5 req-d60b6740-b1be-4bd5-a52e-af800ab09302 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:37.117131 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62d58c35-906e-4e53-a252-0fcbedd388b5 req-d60b6740-b1be-4bd5-a52e-af800ab09302 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1432135 Nov 08 04:14:37.182411 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device c08b9ee1-e152-4ab8-a625-655bb485f35b up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:37.204838 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62d58c35-906e-4e53-a252-0fcbedd388b5 req-d99aa1e8-7567-418f-b91e-a427a4e37767 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0840690 Nov 08 04:14:37.269891 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port c08b9ee1-e152-4ab8-a625-655bb485f35b triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:37.271209 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:37.371376 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52d1360-ce66-4151-a6b1-e375577f1244 req-f5b6a36e-11ca-4962-8b0f-66b48ba15026 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:37.373419 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f52d1360-ce66-4151-a6b1-e375577f1244 req-f5b6a36e-11ca-4962-8b0f-66b48ba15026 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 946 time: 0.0927000 Nov 08 04:14:37.398417 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:37.423498 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port c08b9ee1-e152-4ab8-a625-655bb485f35b, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=c08b9ee1-e152-4ab8-a625-655bb485f35b,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:37.466771 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f52d1360-ce66-4151-a6b1-e375577f1244 req-e9b53b2b-6e37-4263-aa8b-63e370e4a12f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0827246 Nov 08 04:14:37.494297 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:37.574003 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=c08b9ee1-e152-4ab8-a625-655bb485f35b,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:37.743471 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2603e5e-2fd9-41f1-9ad2-d720279c8c75 req-5032bc21-5606-401c-9e90-6500b236fe9d tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:37.750775 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b2603e5e-2fd9-41f1-9ad2-d720279c8c75 req-5032bc21-5606-401c-9e90-6500b236fe9d tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0591831 Nov 08 04:14:37.804869 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b2603e5e-2fd9-41f1-9ad2-d720279c8c75 req-bcb58dd1-bc90-4919-834b-196040f4488d tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530462 Nov 08 04:14:37.923637 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f679aef-a92d-44a7-8031-1ae8106f5452 req-c0426ff8-2766-4c77-9bd4-ce2956589044 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:37.925393 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f679aef-a92d-44a7-8031-1ae8106f5452 req-c0426ff8-2766-4c77-9bd4-ce2956589044 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 945 time: 0.0584240 Nov 08 04:14:37.960414 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54204) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:37.965014 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-f1b5f8b1-f9a9-4bce-b714-717b6c03dce5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1718587729', 'description': 'tempest-secgroup-smoke-1718587729 description', 'project_id': 'aa58a6fe20a449858977c517ca68518b'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:38.002289 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f679aef-a92d-44a7-8031-1ae8106f5452 req-dec29142-d27d-4c0e-84b3-12245c3d8cd7 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709245 Nov 08 04:14:38.078135 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a994e31-21c1-42e3-9ca1-6af52bdfe51c req-1d421f59-a1c4-4c9f-9c46-c2c9dca51fe6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:38.080513 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2a994e31-21c1-42e3-9ca1-6af52bdfe51c req-1d421f59-a1c4-4c9f-9c46-c2c9dca51fe6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0545213 Nov 08 04:14:38.088653 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f1b5f8b1-f9a9-4bce-b714-717b6c03dce5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:38.158865 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2a994e31-21c1-42e3-9ca1-6af52bdfe51c req-b213e861-5142-4f51-b5bd-ebb7374b97c4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664668 Nov 08 04:14:38.186637 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f1b5f8b1-f9a9-4bce-b714-717b6c03dce5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:38.250578 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f1b5f8b1-f9a9-4bce-b714-717b6c03dce5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:38.254162 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Sync routers for ids ['dbf47dba-2137-4db8-a25b-98db4696ddc4'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:14:38.269501 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Routers {'dbf47dba-2137-4db8-a25b-98db4696ddc4'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:14:38.270151 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:14:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['dbf47dba-2137-4db8-a25b-98db4696ddc4'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:38.297801 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1b5f8b1-f9a9-4bce-b714-717b6c03dce5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:38.347679 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f1b5f8b1-f9a9-4bce-b714-717b6c03dce5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:38.353328 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f1b5f8b1-f9a9-4bce-b714-717b6c03dce5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3918130 Nov 08 04:14:38.354238 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54214) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:38.359582 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-86646a86-20ce-4e4f-8ca3-b4178cedb67e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'security_group_rule': {'security_group_id': 'b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb', 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:38.430237 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-253f73a6-a68b-42a8-9d04-c82f9684de3a req-4648be5a-69d3-4490-b3de-c3f85dc78b7d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:38.432035 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-253f73a6-a68b-42a8-9d04-c82f9684de3a req-4648be5a-69d3-4490-b3de-c3f85dc78b7d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1077967 Nov 08 04:14:38.447879 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Set router dbf47dba-2137-4db8-a25b-98db4696ddc4 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:14:38.501370 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-253f73a6-a68b-42a8-9d04-c82f9684de3a req-d1ad0dcf-a2ea-4d71-bfa7-50234d0899f3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0560522 Nov 08 04:14:38.517722 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-86646a86-20ce-4e4f-8ca3-b4178cedb67e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:38.597984 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-86646a86-20ce-4e4f-8ca3-b4178cedb67e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:38.683036 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-86646a86-20ce-4e4f-8ca3-b4178cedb67e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:38.716155 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86646a86-20ce-4e4f-8ca3-b4178cedb67e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=35d75f71-14ae-43be-97de-77430d5bbcb2,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:38.720855 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d59b147b-8f49-46cb-ae46-2cbae9ad435a req-c099a307-da5d-4acb-822c-6a02b5e16c6e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:38.730534 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d59b147b-8f49-46cb-ae46-2cbae9ad435a req-c099a307-da5d-4acb-822c-6a02b5e16c6e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0699935 Nov 08 04:14:38.749018 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'name': 'tempest-TestVolumeBootPattern-837607712-router', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49'}], 'enable_snat': True}, 'gw_port_id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:28Z', 'updated_at': '2021-11-08T04:14:34Z', 'revision_number': 4, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'gw_port': {'id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:c1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 349, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:29Z', 'updated_at': '2021-11-08T04:14:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0cd56535-8b05-4a35-bc64-4224a5f89118', 'name': '', 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'mac_address': 'fa:16:3e:24:6c:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:33Z', 'updated_at': '2021-11-08T04:14:34Z', 'revision_number': 2, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'subnets': [{'id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:38.779552 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d59b147b-8f49-46cb-ae46-2cbae9ad435a req-19a01cae-dc62-472d-bed1-63391f5f5ae2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482445 Nov 08 04:14:38.784583 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Checking router: dbf47dba-2137-4db8-a25b-98db4696ddc4 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:14:38.784942 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Updating router dbf47dba-2137-4db8-a25b-98db4696ddc4 port 0cd56535-8b05-4a35-bc64-4224a5f89118 binding host dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:14:38.810404 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-86646a86-20ce-4e4f-8ca3-b4178cedb67e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:38.811673 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-86646a86-20ce-4e4f-8ca3-b4178cedb67e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4562342 Nov 08 04:14:38.815442 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54220) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:38.833971 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:38.835340 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-a2172b72-6331-4ef3-a7a3-5305d325e6a2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'security_group_rule': {'security_group_id': 'b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb', 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:38.951703 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a2172b72-6331-4ef3-a7a3-5305d325e6a2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:39.003352 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fff9f9ed-f7ac-44a2-adf3-f070e544888a req-1e25f3db-4a22-414e-afee-e328303c79d3 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:39.005512 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fff9f9ed-f7ac-44a2-adf3-f070e544888a req-1e25f3db-4a22-414e-afee-e328303c79d3 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1055093 Nov 08 04:14:39.096087 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fff9f9ed-f7ac-44a2-adf3-f070e544888a req-b8b38a05-aef7-46dd-bcd6-fdebd5769d0f tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0795889 Nov 08 04:14:39.156071 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device c08b9ee1-e152-4ab8-a625-655bb485f35b up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:39.230666 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75f862a-97da-4ed4-859e-06bd9a397c29 req-afe69445-73e5-4b00-a662-3607ba38b203 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:39.235372 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e75f862a-97da-4ed4-859e-06bd9a397c29 req-afe69445-73e5-4b00-a662-3607ba38b203 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 945 time: 0.1037548 Nov 08 04:14:39.268370 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port c08b9ee1-e152-4ab8-a625-655bb485f35b triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:39.268904 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:39.301163 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e75f862a-97da-4ed4-859e-06bd9a397c29 req-099675ea-83da-4a5b-b238-b5b20d429594 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595996 Nov 08 04:14:39.306808 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Publish callbacks [] for port, precommit_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:39.338521 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a2172b72-6331-4ef3-a7a3-5305d325e6a2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:39.483017 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:39.483521 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a2172b72-6331-4ef3-a7a3-5305d325e6a2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:39.510871 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2172b72-6331-4ef3-a7a3-5305d325e6a2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5a6d4ce9-a61f-4331-83eb-d99cdc492b02,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:39.551072 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Pushing event updated for resources: {'Port': ['ID=0cd56535-8b05-4a35-bc64-4224a5f89118,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:39.581594 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.583531 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.583531 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.583531 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.583531 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.583949 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.584299 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.584726 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.585165 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.585585 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.586004 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.586419 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:39.607814 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a2172b72-6331-4ef3-a7a3-5305d325e6a2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:39.612769 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a2172b72-6331-4ef3-a7a3-5305d325e6a2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.7936316 Nov 08 04:14:39.612943 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 54230) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:39.618016 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'security_group_rule': {'security_group_id': 'b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb', 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:39.643953 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Attempting to bind port 0cd56535-8b05-4a35-bc64-4224a5f89118 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:14:39.644438 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Attempting to bind port 0cd56535-8b05-4a35-bc64-4224a5f89118 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9aaa3351-d0b4-46e7-bff2-5b43e82306c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:14:39.644778 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Attempting to bind port 0cd56535-8b05-4a35-bc64-4224a5f89118 on network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:14:39.650735 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 14, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:14:39.651026 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Checking segment: {'id': '9aaa3351-d0b4-46e7-bff2-5b43e82306c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:14:39.651423 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:39.654610 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Bound using segment: {'id': '9aaa3351-d0b4-46e7-bff2-5b43e82306c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:14:39.655142 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Bound port: 0cd56535-8b05-4a35-bc64-4224a5f89118, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9aaa3351-d0b4-46e7-bff2-5b43e82306c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 182, 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:14:39.655533 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:39.759777 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] For port 0cd56535-8b05-4a35-bc64-4224a5f89118, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:14:39.761134 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e95e9a47-b34b-419c-bde9-c6f27b33960d req-22295275-63a3-487e-829f-6896640956e8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:39.769002 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] For port 0cd56535-8b05-4a35-bc64-4224a5f89118, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0cd56535-8b05-4a35-bc64-4224a5f89118,segment=NetworkSegment(9aaa3351-d0b4-46e7-bff2-5b43e82306c5),segment_id=9aaa3351-d0b4-46e7-bff2-5b43e82306c5)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:14:39.769193 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e95e9a47-b34b-419c-bde9-c6f27b33960d req-22295275-63a3-487e-829f-6896640956e8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1173260 Nov 08 04:14:39.851683 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:40.095531 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:40.139571 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e95e9a47-b34b-419c-bde9-c6f27b33960d req-177cb4f4-d8b2-45c0-915f-bd87f054b095 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3645387 Nov 08 04:14:40.177380 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-3d667917-9157-4f79-b60b-018b01e86e35 None None] Provisioning complete for port 0cd56535-8b05-4a35-bc64-4224a5f89118 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:40.177757 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3d667917-9157-4f79-b60b-018b01e86e35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:40.184643 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Routers {'dbf47dba-2137-4db8-a25b-98db4696ddc4'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:14:40.185686 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:14:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['dbf47dba-2137-4db8-a25b-98db4696ddc4'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:40.187050 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c165816-e0a2-4750-a13b-dce6c082172d req-6dce0957-adcc-4044-ae83-8280016c44fd tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:40.189431 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c19748e3-16a9-4207-b85b-89d9cebdfdc8 None None] Pushing event updated for resources: {'Port': ['ID=0cd56535-8b05-4a35-bc64-4224a5f89118,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:40.193786 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0c165816-e0a2-4750-a13b-dce6c082172d req-6dce0957-adcc-4044-ae83-8280016c44fd tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1486971 Nov 08 04:14:40.318759 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:40.328813 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0c165816-e0a2-4750-a13b-dce6c082172d req-8d7d7e80-4279-4c54-8444-ba85b8f1debb tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1317966 Nov 08 04:14:40.341986 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97aeaf5d-3bb6-4d54-b75e-bd1ed73112d8 req-ab1b1877-5c29-4336-89d9-a23362076673 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:40.343594 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-97aeaf5d-3bb6-4d54-b75e-bd1ed73112d8 req-ab1b1877-5c29-4336-89d9-a23362076673 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1080818 Nov 08 04:14:40.394935 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] Set router dbf47dba-2137-4db8-a25b-98db4696ddc4 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:14:40.416317 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-97aeaf5d-3bb6-4d54-b75e-bd1ed73112d8 req-8f56d0da-1044-4294-add1-d0046662c75f tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0632310 Nov 08 04:14:40.454731 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3d667917-9157-4f79-b60b-018b01e86e35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:40.466501 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7126044-1cea-4582-a55d-ac03f9869ea3 req-291aa5b6-577d-4d09-8da3-910b8f8177dd tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:40.468012 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f7126044-1cea-4582-a55d-ac03f9869ea3 req-291aa5b6-577d-4d09-8da3-910b8f8177dd tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 945 time: 0.0506618 Nov 08 04:14:40.519315 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f7126044-1cea-4582-a55d-ac03f9869ea3 req-d7267373-840d-47c2-9e78-169328d21b9a tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442359 Nov 08 04:14:40.563518 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-3d667917-9157-4f79-b60b-018b01e86e35 None None] For port 0cd56535-8b05-4a35-bc64-4224a5f89118, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0cd56535-8b05-4a35-bc64-4224a5f89118,segment=NetworkSegment(9aaa3351-d0b4-46e7-bff2-5b43e82306c5),segment_id=9aaa3351-d0b4-46e7-bff2-5b43e82306c5)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:40.679179 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:40.680609 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3d667917-9157-4f79-b60b-018b01e86e35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:40.686068 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'name': 'tempest-TestVolumeBootPattern-837607712-router', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49'}], 'enable_snat': True}, 'gw_port_id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:28Z', 'updated_at': '2021-11-08T04:14:34Z', 'revision_number': 4, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'gw_port': {'id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:c1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 349, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:29Z', 'updated_at': '2021-11-08T04:14:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0cd56535-8b05-4a35-bc64-4224a5f89118', 'name': '', 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'mac_address': 'fa:16:3e:24:6c:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:33Z', 'updated_at': '2021-11-08T04:14:39Z', 'revision_number': 4, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'subnets': [{'id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:40.694423 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cd5502ca-ed8c-408c-9695-4e50a8e8375c,revision_number=0']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:40.707114 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.707466 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.707799 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.708127 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.708446 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.708773 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.709095 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.709418 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.709751 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.710058 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.710371 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.710744 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:14:40.739700 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f486957e-0368-4745-9332-6d36fdeee827 None None] The sync data for ids ['dbf47dba-2137-4db8-a25b-98db4696ddc4'] in dv-cinder-783643-4-iscsi is: [{'id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'name': 'tempest-TestVolumeBootPattern-837607712-router', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49'}], 'enable_snat': True}, 'gw_port_id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:28Z', 'updated_at': '2021-11-08T04:14:34Z', 'revision_number': 4, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'gw_port': {'id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:c1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 349, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:29Z', 'updated_at': '2021-11-08T04:14:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0cd56535-8b05-4a35-bc64-4224a5f89118', 'name': '', 'network_id': '2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'mac_address': 'fa:16:3e:24:6c:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_interface', 'standard_attr_id': 350, 'fixed_ips': [{'subnet_id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:33Z', 'updated_at': '2021-11-08T04:14:39Z', 'revision_number': 4, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'subnets': [{'id': 'd7135ca5-abad-42c8-9fca-b5f1575cea78', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:14:40.787593 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d667917-9157-4f79-b60b-018b01e86e35 None None] Pushing event updated for resources: {'Port': ['ID=0cd56535-8b05-4a35-bc64-4224a5f89118,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:40.810745 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:40.814379 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-7e9f9153-b804-4e1b-9ee4-edcef24b3d5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.2003925 Nov 08 04:14:40.849479 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54246) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:40.850469 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-6b8798f8-1f9f-4776-87b9-cdc9de6c6a10 None None] Provisioning complete for port 0cd56535-8b05-4a35-bc64-4224a5f89118 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:40.851062 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-6b8798f8-1f9f-4776-87b9-cdc9de6c6a10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:40.874090 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-72ec24ee-1f6f-48b0-928e-2459737fa178 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'security_group_rule': {'security_group_id': 'b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb', 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:40.895511 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a3c49a8-e0b6-4272-b601-dcf3fb0f5f2c req-3dd832ed-8370-4969-b0ba-f5038ee4d25f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:40.897637 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a3c49a8-e0b6-4272-b601-dcf3fb0f5f2c req-3dd832ed-8370-4969-b0ba-f5038ee4d25f service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=e9678ed98e7944babc4f6af7fb368440&device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 1098 time: 0.1076593 Nov 08 04:14:40.949789 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d77d013f-7ece-42c9-a5bd-93356634285a req-818f0255-c30c-4dbd-8476-0a36f15c60d1 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:40.951706 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-d77d013f-7ece-42c9-a5bd-93356634285a req-818f0255-c30c-4dbd-8476-0a36f15c60d1 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 945 time: 0.1607955 Nov 08 04:14:41.110651 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [req-d77d013f-7ece-42c9-a5bd-93356634285a req-b0427dd5-fd98-45df-b42b-1aac2afca231 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Deleting port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:14:41.112701 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-d77d013f-7ece-42c9-a5bd-93356634285a req-b0427dd5-fd98-45df-b42b-1aac2afca231 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:41.126822 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-72ec24ee-1f6f-48b0-928e-2459737fa178 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:41.149906 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a3c49a8-e0b6-4272-b601-dcf3fb0f5f2c req-dce676cd-9966-4523-a7fb-8ab588e20219 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:41.151553 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a3c49a8-e0b6-4272-b601-dcf3fb0f5f2c req-dce676cd-9966-4523-a7fb-8ab588e20219 service neutron] 10.222.0.16 "GET /v2.0/networks?id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 200 len: 920 time: 0.2457321 Nov 08 04:14:41.223132 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0cd56535-8b05-4a35-bc64-4224a5f89118 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:14:41.245646 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a3c49a8-e0b6-4272-b601-dcf3fb0f5f2c req-5acb551f-2e38-4c2b-b9af-72b85f394fc2 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000 HTTP/1.1" status: 200 len: 217 time: 0.0822382 Nov 08 04:14:41.335526 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 0cd56535-8b05-4a35-bc64-4224a5f89118 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:14:41.335999 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:41.453864 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-72ec24ee-1f6f-48b0-928e-2459737fa178 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:41.465372 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-d77d013f-7ece-42c9-a5bd-93356634285a req-b0427dd5-fd98-45df-b42b-1aac2afca231 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] For port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:41.465372 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-d77d013f-7ece-42c9-a5bd-93356634285a req-b0427dd5-fd98-45df-b42b-1aac2afca231 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:41.477468 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a3c49a8-e0b6-4272-b601-dcf3fb0f5f2c req-db5bac87-87f7-4dc8-a1a8-805b979e3b46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:41.479049 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a3c49a8-e0b6-4272-b601-dcf3fb0f5f2c req-db5bac87-87f7-4dc8-a1a8-805b979e3b46 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=900a12a5-1baa-47e1-8b64-245dc70bc9f2 HTTP/1.1" status: 200 len: 859 time: 0.2252140 Nov 08 04:14:41.499146 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [req-d77d013f-7ece-42c9-a5bd-93356634285a req-b0427dd5-fd98-45df-b42b-1aac2afca231 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Calling delete_port for 946fbfcb-ea3d-434f-9d42-bd6883f13e5d owned by compute:nova {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:14:41.535466 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8909789-576c-4e10-9b49-1cbf632acb57 req-91bd9ea0-ec7f-402a-9230-6b9aefe34400 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:41.540479 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c8909789-576c-4e10-9b49-1cbf632acb57 req-91bd9ea0-ec7f-402a-9230-6b9aefe34400 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1972663 Nov 08 04:14:41.543251 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a3c49a8-e0b6-4272-b601-dcf3fb0f5f2c req-12e9c3d9-9cb3-464e-8a51-621c2da58a43 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0495603 Nov 08 04:14:41.628714 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-72ec24ee-1f6f-48b0-928e-2459737fa178 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:41.659478 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72ec24ee-1f6f-48b0-928e-2459737fa178 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d48af3c7-33c1-4a33-9ae9-cea4067ccd6f,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:41.733135 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717a2333-21b2-4647-b328-7f14bd9315d6 req-43fe9cf5-3f15-4eca-a4ab-c05f877d4fec tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:41.744588 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-717a2333-21b2-4647-b328-7f14bd9315d6 req-43fe9cf5-3f15-4eca-a4ab-c05f877d4fec tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.2153497 Nov 08 04:14:41.762137 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c8909789-576c-4e10-9b49-1cbf632acb57 req-21942d56-794b-4c3f-81db-30e6059d768e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2075620 Nov 08 04:14:41.789969 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-72ec24ee-1f6f-48b0-928e-2459737fa178 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:41.793743 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-72ec24ee-1f6f-48b0-928e-2459737fa178 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.9373167 Nov 08 04:14:41.794111 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54270) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:41.800643 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-d06a9f23-e11a-4870-ba18-1128fe784236 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'security_group_rule': {'security_group_id': 'b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb', 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:41.848163 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-d77d013f-7ece-42c9-a5bd-93356634285a req-b0427dd5-fd98-45df-b42b-1aac2afca231 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:41.849215 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a3c49a8-e0b6-4272-b601-dcf3fb0f5f2c req-f9019473-7ea3-44cf-a7a2-cf03a2e8fa6f service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2967062 Nov 08 04:14:41.883440 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['f790fbae-e681-4e01-b1a4-67513d491300', '946fbfcb-ea3d-434f-9d42-bd6883f13e5d'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:14:41.899843 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0427dd5-fd98-45df-b42b-1aac2afca231 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Pushing event deleted for resources: {'Port': ['ID=946fbfcb-ea3d-434f-9d42-bd6883f13e5d,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:41.942606 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.securitygroups_db [None req-d06a9f23-e11a-4870-ba18-1128fe784236 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Project aa58a6fe20a449858977c517ca68518b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 04:14:41.971693 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d06a9f23-e11a-4870-ba18-1128fe784236 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:41.974428 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [req-d77d013f-7ece-42c9-a5bd-93356634285a req-b0427dd5-fd98-45df-b42b-1aac2afca231 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] No DVR routers for this DVR port 946fbfcb-ea3d-434f-9d42-bd6883f13e5d on host hv-cinder-78364 {{(pid=101664) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:14:41.978184 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-d77d013f-7ece-42c9-a5bd-93356634285a req-b0427dd5-fd98-45df-b42b-1aac2afca231 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:41.985026 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-d77d013f-7ece-42c9-a5bd-93356634285a req-b0427dd5-fd98-45df-b42b-1aac2afca231 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "DELETE /v2.0/ports/946fbfcb-ea3d-434f-9d42-bd6883f13e5d HTTP/1.1" status: 204 len: 173 time: 1.0219522 Nov 08 04:14:41.985934 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '42fd1d8f-82f7-4a08-9078-ff02a30df4e6', 'name': 'network-vif-deleted', 'tag': '946fbfcb-ea3d-434f-9d42-bd6883f13e5d'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:41.988888 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50de8566-4ff2-456c-aa37-5ce40c043af7" -d '{"events": [{"server_uuid": "42fd1d8f-82f7-4a08-9078-ff02a30df4e6", "name": "network-vif-deleted", "tag": "946fbfcb-ea3d-434f-9d42-bd6883f13e5d"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:42.017179 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-717a2333-21b2-4647-b328-7f14bd9315d6 req-04db12e2-ea98-4606-b1f7-de5fa4c8a418 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2654154 Nov 08 04:14:42.051984 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a3c49a8-e0b6-4272-b601-dcf3fb0f5f2c req-daeea78e-ac60-4199-b10f-7436b0d38be8 service neutron] 10.222.0.16 "GET /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1857178 Nov 08 04:14:42.090758 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d06a9f23-e11a-4870-ba18-1128fe784236 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:42.142312 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d06a9f23-e11a-4870-ba18-1128fe784236 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:42.163783 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d06a9f23-e11a-4870-ba18-1128fe784236 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f66d7fae-a8ce-4ddd-b765-6cb328d19a11,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:42.167398 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61d84ea5-eb5f-40ef-9fd5-758e813e26f1 req-1de0becf-fa00-48c1-a21f-702a95d4b37c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:42.169239 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-61d84ea5-eb5f-40ef-9fd5-758e813e26f1 req-1de0becf-fa00-48c1-a21f-702a95d4b37c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0642307 Nov 08 04:14:42.219492 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d06a9f23-e11a-4870-ba18-1128fe784236 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:42.221671 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-d06a9f23-e11a-4870-ba18-1128fe784236 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4252515 Nov 08 04:14:42.223985 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54276) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:42.230583 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-5442302d-53a0-47dd-9622-849c2eb9984e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'security_group_rule': {'security_group_id': 'b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb', 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:14:42.242926 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-61d84ea5-eb5f-40ef-9fd5-758e813e26f1 req-58e2dadb-46fe-4835-9ae8-58a887aae968 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0672593 Nov 08 04:14:42.288999 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-263df187-f493-44f9-b49c-c158fbfeaa58 req-4098c614-8805-4fe3-8adf-0c9f7d59d14f tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 210 time: 0.0274944 Nov 08 04:14:42.291300 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e013d38-0f91-4a35-81de-754a13663751 x-openstack-request-id: req-1e013d38-0f91-4a35-81de-754a13663751 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:42.291648 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "42fd1d8f-82f7-4a08-9078-ff02a30df4e6", "name": "network-vif-deleted", "tag": "946fbfcb-ea3d-434f-9d42-bd6883f13e5d", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:42.291839 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-1e013d38-0f91-4a35-81de-754a13663751 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:42.292235 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '42fd1d8f-82f7-4a08-9078-ff02a30df4e6', 'name': 'network-vif-deleted', 'tag': '946fbfcb-ea3d-434f-9d42-bd6883f13e5d', 'status': 'completed', 'code': 200} Nov 08 04:14:42.381969 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad34254-9acc-43af-945d-bc656d12a1da req-858990f7-e564-4ec3-8571-7cd0f3423d5f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:42.383479 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ad34254-9acc-43af-945d-bc656d12a1da req-858990f7-e564-4ec3-8571-7cd0f3423d5f tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 946 time: 0.0488300 Nov 08 04:14:42.425497 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.securitygroups_db [None req-5442302d-53a0-47dd-9622-849c2eb9984e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Project aa58a6fe20a449858977c517ca68518b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 04:14:42.429759 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ad34254-9acc-43af-945d-bc656d12a1da req-c74c5593-a5df-4e8a-bfc8-013031793978 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405037 Nov 08 04:14:42.433074 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5442302d-53a0-47dd-9622-849c2eb9984e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:42.493405 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5442302d-53a0-47dd-9622-849c2eb9984e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:42.581793 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5442302d-53a0-47dd-9622-849c2eb9984e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:42.598823 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5442302d-53a0-47dd-9622-849c2eb9984e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0b7ef33f-68d4-4d73-b962-ca474912e240,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:42.650374 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a76b86e9-c3c7-4893-b4af-2f720bd943f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:42.679465 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5442302d-53a0-47dd-9622-849c2eb9984e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:42.680842 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-5442302d-53a0-47dd-9622-849c2eb9984e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4556060 Nov 08 04:14:42.876092 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3af2050-45de-4564-95ec-7f85529b27be req-08633001-a3d2-4746-be09-a0d59e61454b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:42.877557 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a3af2050-45de-4564-95ec-7f85529b27be req-08633001-a3d2-4746-be09-a0d59e61454b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0522952 Nov 08 04:14:42.928663 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a3af2050-45de-4564-95ec-7f85529b27be req-76e1d4d9-2d80-490d-a1b4-fe39ba5b4187 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452292 Nov 08 04:14:43.123558 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77bbe9f5-82c6-4d80-982e-440a07c823c2 req-5b432715-2b56-4134-b03e-ef2a66dc16d6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:43.125148 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-77bbe9f5-82c6-4d80-982e-440a07c823c2 req-5b432715-2b56-4134-b03e-ef2a66dc16d6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0489347 Nov 08 04:14:43.170745 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-77bbe9f5-82c6-4d80-982e-440a07c823c2 req-620d6a22-1a22-4abd-9582-485acd36ce2e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398421 Nov 08 04:14:43.358799 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e084ff-5548-4e63-8fb5-1f8f916b6d1c req-42933648-8656-4d70-856c-874013dcf446 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:43.360755 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-79e084ff-5548-4e63-8fb5-1f8f916b6d1c req-42933648-8656-4d70-856c-874013dcf446 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0506458 Nov 08 04:14:43.391140 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b8939fe7-2830-426f-83fd-8fab8029b16c req-a9e40922-0453-41e0-bdfc-d094db8e4069 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 210 time: 0.0294325 Nov 08 04:14:43.433043 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-79e084ff-5548-4e63-8fb5-1f8f916b6d1c req-4a9ec354-f843-4f2b-b0cf-73ac66613b24 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633020 Nov 08 04:14:43.545233 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409a9594-a3aa-4909-97a7-4728d10f3468 req-86c896b3-cce4-48ee-8f57-a1d0450f45fe tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:43.546725 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-409a9594-a3aa-4909-97a7-4728d10f3468 req-86c896b3-cce4-48ee-8f57-a1d0450f45fe tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 946 time: 0.0504150 Nov 08 04:14:43.594876 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-409a9594-a3aa-4909-97a7-4728d10f3468 req-114ec9a2-9e53-4f16-9933-d780953a4e4b tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413656 Nov 08 04:14:44.051396 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d4fa15-a2c9-4e13-8a97-c8f019696bad req-bad8f27e-d6ae-4b74-9f4b-6ae8250ae1e3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:44.052888 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f5d4fa15-a2c9-4e13-8a97-c8f019696bad req-bad8f27e-d6ae-4b74-9f4b-6ae8250ae1e3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0530574 Nov 08 04:14:44.107228 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f5d4fa15-a2c9-4e13-8a97-c8f019696bad req-07b4d463-5e37-4bf3-b094-5ce66d45dcad tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484772 Nov 08 04:14:44.295080 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83616c86-4f3c-43c0-968f-c8de861c0158 req-c12333d0-cb52-4845-b968-afee7282a04f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:44.296530 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-83616c86-4f3c-43c0-968f-c8de861c0158 req-c12333d0-cb52-4845-b968-afee7282a04f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0565429 Nov 08 04:14:44.350712 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-83616c86-4f3c-43c0-968f-c8de861c0158 req-03ea114e-7d19-476a-bcda-553da6e008c5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458384 Nov 08 04:14:44.571045 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5db5258-f209-4cee-974c-5c7c37de23e9 req-ec3be199-f1c1-441b-b267-99ae2fe75954 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 210 time: 0.0301816 Nov 08 04:14:44.621683 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-752453c8-d5a2-4419-8738-1f1384033f56 req-c0f5c4de-a88d-46e1-8865-94cf2a5b4da2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:44.623220 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-752453c8-d5a2-4419-8738-1f1384033f56 req-c0f5c4de-a88d-46e1-8865-94cf2a5b4da2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0550418 Nov 08 04:14:44.685012 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-752453c8-d5a2-4419-8738-1f1384033f56 req-6339f62f-33dd-4aa2-8df7-dc83bd0e3e46 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0559516 Nov 08 04:14:44.724555 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f016e491-85a6-42fc-8143-6e8d67072b56 req-c1c78e49-8f4a-4c33-ab69-08cfa4be7986 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:44.725961 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f016e491-85a6-42fc-8143-6e8d67072b56 req-c1c78e49-8f4a-4c33-ab69-08cfa4be7986 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 946 time: 0.0577550 Nov 08 04:14:44.774351 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f016e491-85a6-42fc-8143-6e8d67072b56 req-796c41f3-bdbe-4be0-803c-b357aa9ba6ec tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425098 Nov 08 04:14:44.960301 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 946fbfcb-ea3d-434f-9d42-bd6883f13e5d no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:14:44.979328 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: 946fbfcb-ea3d-434f-9d42-bd6883f13e5d {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:14:44.979672 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 946fbfcb-ea3d-434f-9d42-bd6883f13e5d not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:14:45.164615 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a50f43a2-5a40-4256-9965-2e20b9d13b88 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:45.236365 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e32f70f0-0545-497a-8ab1-0fc5507fbcb5 req-29149532-b966-4da4-be0c-a17c6af20ffc tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:45.237781 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e32f70f0-0545-497a-8ab1-0fc5507fbcb5 req-29149532-b966-4da4-be0c-a17c6af20ffc tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0540764 Nov 08 04:14:45.285565 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e32f70f0-0545-497a-8ab1-0fc5507fbcb5 req-f05478e8-d217-444c-8566-6512cbdac88a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418544 Nov 08 04:14:45.470143 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6e2030-68a4-469f-a155-be1b003e99bb req-380d2af0-cd6d-4d63-ab3a-484f5692c9c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:45.471641 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eb6e2030-68a4-469f-a155-be1b003e99bb req-380d2af0-cd6d-4d63-ab3a-484f5692c9c7 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0501397 Nov 08 04:14:45.524044 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eb6e2030-68a4-469f-a155-be1b003e99bb req-0f7c8f04-a3ee-4dd5-ae33-547b00210bc6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464363 Nov 08 04:14:45.685550 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b36d4e84-83be-4ddb-a5c8-e2884680c4d4 req-3a500c4c-a5b4-4f85-afbf-5c70828cd9ff tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=42fd1d8f-82f7-4a08-9078-ff02a30df4e6 HTTP/1.1" status: 200 len: 210 time: 0.0266600 Nov 08 04:14:45.819832 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd396a3-c17c-49f9-8ae3-6b35538038f6 req-a63db10e-4da4-4b2d-be38-30d0a7bfbd21 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:45.821369 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4dd396a3-c17c-49f9-8ae3-6b35538038f6 req-a63db10e-4da4-4b2d-be38-30d0a7bfbd21 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0627441 Nov 08 04:14:45.928839 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4dd396a3-c17c-49f9-8ae3-6b35538038f6 req-aea5dbc2-0e7d-45fc-906e-eaae8297f741 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1016176 Nov 08 04:14:45.960035 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:45.973454 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d475ae-fa54-48d3-9e18-f7b6c0e8049a req-b3eeb42d-d8e6-4a48-80f4-7a8cbc18f8a7 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:45.975148 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5d475ae-fa54-48d3-9e18-f7b6c0e8049a req-b3eeb42d-d8e6-4a48-80f4-7a8cbc18f8a7 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 946 time: 0.1197937 Nov 08 04:14:45.989259 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-4e39a33c-d612-4cc1-b772-540c85412f2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:45.990682 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-4e39a33c-d612-4cc1-b772-540c85412f2b service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 1098 time: 0.0774839 Nov 08 04:14:46.080353 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5d475ae-fa54-48d3-9e18-f7b6c0e8049a req-6fab3d28-24b0-4894-9a57-8828a4769079 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991073 Nov 08 04:14:46.115533 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-480b8b89-4554-4b7a-9608-f09dccdc17b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:46.116990 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-480b8b89-4554-4b7a-9608-f09dccdc17b8 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 918 time: 0.1160667 Nov 08 04:14:46.197084 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-08ef1a95-553f-46b3-b9a0-f622fff2b785 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e6483e56-c377-4575-bd34-b26a5c2bf382 HTTP/1.1" status: 200 len: 1000 time: 0.0702434 Nov 08 04:14:46.267951 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-7909d61f-9b4e-4fb6-9c76-c5fcdee6794c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:46.269325 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-7909d61f-9b4e-4fb6-9c76-c5fcdee6794c service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.0462716 Nov 08 04:14:46.326122 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-045d7b71-c61e-47f2-a95b-893da15edc44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:46.327663 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-045d7b71-c61e-47f2-a95b-893da15edc44 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0487177 Nov 08 04:14:46.469110 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e39da11-d173-4678-a110-f2771994aada req-b7f37c4e-4d4b-4120-81fc-ca541a4bb116 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:46.470694 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4e39da11-d173-4678-a110-f2771994aada req-b7f37c4e-4d4b-4120-81fc-ca541a4bb116 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.1035659 Nov 08 04:14:46.476440 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-d386ea2d-48df-4e63-adc5-342436af1c38 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1317012 Nov 08 04:14:46.574013 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4e39da11-d173-4678-a110-f2771994aada req-5df8dc4a-55fe-4d0c-94ca-5cb11272e3f3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0966356 Nov 08 04:14:46.634858 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98247341-198b-4a46-80c0-d3968d8bd9c6 req-8484af08-9beb-46f0-b44e-2c806de53a08 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1361060 Nov 08 04:14:46.670432 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51131cf-ffd1-4080-a3d9-9ac4e0fc17e9 req-34954dd3-7467-47a2-850b-c1a4369d1507 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:46.672468 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a51131cf-ffd1-4080-a3d9-9ac4e0fc17e9 req-34954dd3-7467-47a2-850b-c1a4369d1507 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0584943 Nov 08 04:14:46.718317 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a51131cf-ffd1-4080-a3d9-9ac4e0fc17e9 req-c62530bb-45f2-425e-9fe5-840793ba2338 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396366 Nov 08 04:14:47.074992 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a270abdf-5421-4d7b-8b3a-8d40777eeca5 req-2bd34a85-cfe9-4b5e-9282-00403674fcae tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:47.076476 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a270abdf-5421-4d7b-8b3a-8d40777eeca5 req-2bd34a85-cfe9-4b5e-9282-00403674fcae tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0517912 Nov 08 04:14:47.126079 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a270abdf-5421-4d7b-8b3a-8d40777eeca5 req-595f9719-8b45-484c-8a87-b912ba4d6e47 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416257 Nov 08 04:14:47.199370 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0678b8-8f92-4675-9a1a-103ca4174075 req-b7e2736e-18e7-4415-8589-a3b8ef55b927 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:47.200754 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6f0678b8-8f92-4675-9a1a-103ca4174075 req-b7e2736e-18e7-4415-8589-a3b8ef55b927 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 946 time: 0.0473988 Nov 08 04:14:47.246685 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6f0678b8-8f92-4675-9a1a-103ca4174075 req-57102959-5ba5-40c3-866c-343021207da2 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/security-groups?id=7e01fc88-1e6e-4e50-bc53-6c52498c7510&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395043 Nov 08 04:14:47.587839 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:47.637796 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-4d73d9b0-7525-46ee-bea6-6274e98d3bf2 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:47.639362 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-4d73d9b0-7525-46ee-bea6-6274e98d3bf2 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.16 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 946 time: 0.0514441 Nov 08 04:14:47.757760 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1bf5618-8b17-4681-9ea0-8a61421a9ffb req-d33a86df-4c0a-4225-afa1-e51829701c30 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:47.758143 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f1bf5618-8b17-4681-9ea0-8a61421a9ffb req-d33a86df-4c0a-4225-afa1-e51829701c30 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0832489 Nov 08 04:14:47.793997 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-0710c0e5-d326-49f3-8c42-0db64d017dab tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Deleting port 64b004cc-acbd-488d-8f5d-2b3d5f02a667 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:14:47.794334 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-0710c0e5-d326-49f3-8c42-0db64d017dab tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:47.910627 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f1bf5618-8b17-4681-9ea0-8a61421a9ffb req-d8c93e53-14e6-441a-b052-e24c4619d106 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1448565 Nov 08 04:14:47.929844 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd43695-3518-4950-ab87-08954f2b4e27 req-0e26980a-7864-408a-8e53-60369fa26ab8 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:47.931404 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dfd43695-3518-4950-ab87-08954f2b4e27 req-0e26980a-7864-408a-8e53-60369fa26ab8 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1340938 Nov 08 04:14:47.968281 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-0710c0e5-d326-49f3-8c42-0db64d017dab tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] For port 64b004cc-acbd-488d-8f5d-2b3d5f02a667, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=64b004cc-acbd-488d-8f5d-2b3d5f02a667,segment=NetworkSegment(352fab34-f426-4ea6-a0d5-2c5b84c3f901),segment_id=352fab34-f426-4ea6-a0d5-2c5b84c3f901)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:47.968653 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-0710c0e5-d326-49f3-8c42-0db64d017dab tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:47.993136 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-0710c0e5-d326-49f3-8c42-0db64d017dab tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Calling delete_port for 64b004cc-acbd-488d-8f5d-2b3d5f02a667 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:14:48.012103 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dfd43695-3518-4950-ab87-08954f2b4e27 req-995725a7-93aa-49c1-b649-113bd11f9432 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741282 Nov 08 04:14:48.179886 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-0710c0e5-d326-49f3-8c42-0db64d017dab tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:48.210953 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0710c0e5-d326-49f3-8c42-0db64d017dab tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Pushing event deleted for resources: {'Port': ['ID=64b004cc-acbd-488d-8f5d-2b3d5f02a667,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:48.222614 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['64b004cc-acbd-488d-8f5d-2b3d5f02a667'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:14:48.275310 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-0710c0e5-d326-49f3-8c42-0db64d017dab tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] No DVR routers for this DVR port 64b004cc-acbd-488d-8f5d-2b3d5f02a667 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:14:48.278128 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-0710c0e5-d326-49f3-8c42-0db64d017dab tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:48.281334 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6a7de6a3-6bc1-4ee3-b2d5-f1e14197b2b5 req-0710c0e5-d326-49f3-8c42-0db64d017dab tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.16 "DELETE /v2.0/ports/64b004cc-acbd-488d-8f5d-2b3d5f02a667 HTTP/1.1" status: 204 len: 173 time: 0.6351051 Nov 08 04:14:48.281819 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd17b73e9-e1f4-4e15-97e0-4239d5edc964', 'name': 'network-vif-deleted', 'tag': '64b004cc-acbd-488d-8f5d-2b3d5f02a667'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:48.284644 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93890d17-260c-462f-8ff8-345991238c54" -d '{"events": [{"server_uuid": "d17b73e9-e1f4-4e15-97e0-4239d5edc964", "name": "network-vif-deleted", "tag": "64b004cc-acbd-488d-8f5d-2b3d5f02a667"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:48.311680 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf711d65-8f66-4c5d-96d6-8409df87f679 req-68b2c292-1aa1-4dd0-9824-8d8ceb879722 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:48.313172 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bf711d65-8f66-4c5d-96d6-8409df87f679 req-68b2c292-1aa1-4dd0-9824-8d8ceb879722 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0790505 Nov 08 04:14:48.362321 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bf711d65-8f66-4c5d-96d6-8409df87f679 req-b6d96aec-abdd-4e6a-85ec-2d32c9858cd0 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419526 Nov 08 04:14:48.397312 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:48.444963 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ac1b0c0-d476-4236-8dcb-db356591f8eb x-openstack-request-id: req-8ac1b0c0-d476-4236-8dcb-db356591f8eb {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:48.445248 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d17b73e9-e1f4-4e15-97e0-4239d5edc964", "name": "network-vif-deleted", "tag": "64b004cc-acbd-488d-8f5d-2b3d5f02a667", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:48.445490 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-8ac1b0c0-d476-4236-8dcb-db356591f8eb {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:48.445876 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd17b73e9-e1f4-4e15-97e0-4239d5edc964', 'name': 'network-vif-deleted', 'tag': '64b004cc-acbd-488d-8f5d-2b3d5f02a667', 'status': 'completed', 'code': 200} Nov 08 04:14:48.448041 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1c49fd80-f602-48ac-89e8-dd7e87430e84 req-d7399454-8f58-457e-b5ac-7b2b6790cbe3 tempest-VolumesActionsTest-2051778277 tempest-VolumesActionsTest-2051778277-project] 10.222.0.21 "GET /v2.0/ports?device_id=d17b73e9-e1f4-4e15-97e0-4239d5edc964 HTTP/1.1" status: 200 len: 210 time: 0.0287948 Nov 08 04:14:48.531499 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524e22a9-38d1-43c1-8ee3-1fbceb507eeb req-09e5eaa2-722f-45e2-b02f-2b8cf617eb83 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:48.533570 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-524e22a9-38d1-43c1-8ee3-1fbceb507eeb req-09e5eaa2-722f-45e2-b02f-2b8cf617eb83 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 946 time: 0.0496416 Nov 08 04:14:48.583407 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-524e22a9-38d1-43c1-8ee3-1fbceb507eeb req-54c54e18-a213-4c91-a195-29a7faee0ef8 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439012 Nov 08 04:14:48.985922 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 64b004cc-acbd-488d-8f5d-2b3d5f02a667 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:14:49.011597 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: 64b004cc-acbd-488d-8f5d-2b3d5f02a667 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:14:49.011928 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 64b004cc-acbd-488d-8f5d-2b3d5f02a667 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:14:49.012348 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device e6483e56-c377-4575-bd34-b26a5c2bf382 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:14:49.042708 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be7a8e9-79ab-4e00-b175-249699e12d81 req-c6d63f39-879f-4bad-a3a0-4196a8b473da tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:49.044254 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4be7a8e9-79ab-4e00-b175-249699e12d81 req-c6d63f39-879f-4bad-a3a0-4196a8b473da tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 945 time: 0.0557733 Nov 08 04:14:49.098687 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4be7a8e9-79ab-4e00-b175-249699e12d81 req-6760b554-b121-43a9-b8e2-5408439f458f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479300 Nov 08 04:14:49.100472 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:49.134235 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:49.139377 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96184230-d53c-42e3-beff-3f898c261c09" -d '{"events": [{"server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "name": "network-vif-unplugged", "status": "completed", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:49.149750 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f3deac-cc7d-409f-b598-664e668b82c5 req-a8b441de-9926-445c-8c04-31342cfd6988 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:49.151270 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-52f3deac-cc7d-409f-b598-664e668b82c5 req-a8b441de-9926-445c-8c04-31342cfd6988 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0518105 Nov 08 04:14:49.159678 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:49.183372 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-20b11be3-6e6f-4db5-8039-0e5489f60356 x-openstack-request-id: req-20b11be3-6e6f-4db5-8039-0e5489f60356 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:49.183756 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "name": "network-vif-unplugged", "status": "completed", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:49.184075 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-20b11be3-6e6f-4db5-8039-0e5489f60356 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:49.184528 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'code': 200} Nov 08 04:14:49.207661 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-52f3deac-cc7d-409f-b598-664e668b82c5 req-652a8b9d-d46f-432d-9e09-6295bcd3e912 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502298 Nov 08 04:14:49.267865 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:49.321182 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=8']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:49.500302 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a12a1b01-fc58-4651-bf1c-7afc83ae5af0 req-cb0836ba-33f0-41b5-a470-dcde4ee245ae tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:49.502636 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a12a1b01-fc58-4651-bf1c-7afc83ae5af0 req-cb0836ba-33f0-41b5-a470-dcde4ee245ae tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0559378 Nov 08 04:14:49.554061 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a12a1b01-fc58-4651-bf1c-7afc83ae5af0 req-87e64395-2d65-4a0e-b703-0dc6ea9ef466 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455956 Nov 08 04:14:49.706543 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b177b1-db2b-4bdd-be1f-174d1060bac0 req-11fb264a-c697-4549-8a25-68ecacc8302d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:49.708014 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6b177b1-db2b-4bdd-be1f-174d1060bac0 req-11fb264a-c697-4549-8a25-68ecacc8302d tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 946 time: 0.0507798 Nov 08 04:14:49.758267 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6b177b1-db2b-4bdd-be1f-174d1060bac0 req-071fc6e6-bad6-4437-9956-49d4a72f7e3f tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442550 Nov 08 04:14:50.218887 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f77d5855-d80c-4ee9-aa17-1af07c4fccd1 req-42196628-c26a-40f7-8573-d1e9f89abe36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:50.220355 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f77d5855-d80c-4ee9-aa17-1af07c4fccd1 req-42196628-c26a-40f7-8573-d1e9f89abe36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0485368 Nov 08 04:14:50.272661 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f77d5855-d80c-4ee9-aa17-1af07c4fccd1 req-7450aeba-4bd3-4274-8da1-b5805aa12f00 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462759 Nov 08 04:14:50.717641 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0254b0f6-045b-493e-a228-4e996f1e5293 req-503e0fe6-c4f3-4345-b5d1-40af94f11b3d tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:50.719399 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0254b0f6-045b-493e-a228-4e996f1e5293 req-503e0fe6-c4f3-4345-b5d1-40af94f11b3d tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0779498 Nov 08 04:14:50.732973 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-d783e689-4275-4ca0-a11d-607636ffcfe6 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:50.735010 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-d783e689-4275-4ca0-a11d-607636ffcfe6 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 946 time: 0.0813477 Nov 08 04:14:50.819408 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0254b0f6-045b-493e-a228-4e996f1e5293 req-afa81473-9606-44e0-9672-f3149f4c55fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0834110 Nov 08 04:14:50.867474 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-e667fc64-c538-49ab-9feb-7dee17622875 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Deleting port f790fbae-e681-4e01-b1a4-67513d491300 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:14:50.867810 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-e667fc64-c538-49ab-9feb-7dee17622875 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:50.983134 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e791f82-f67c-4f31-8fe4-dadda29f9949 req-74f18117-4845-4d94-b985-5eef03a265ee tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:50.984900 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6e791f82-f67c-4f31-8fe4-dadda29f9949 req-74f18117-4845-4d94-b985-5eef03a265ee tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 946 time: 0.1014516 Nov 08 04:14:51.028402 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-e667fc64-c538-49ab-9feb-7dee17622875 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] For port f790fbae-e681-4e01-b1a4-67513d491300, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=f790fbae-e681-4e01-b1a4-67513d491300,segment=NetworkSegment(6af2a9a8-7c62-4511-940f-bdb70a610241),segment_id=6af2a9a8-7c62-4511-940f-bdb70a610241)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:14:51.028785 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-e667fc64-c538-49ab-9feb-7dee17622875 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:51.051574 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-e667fc64-c538-49ab-9feb-7dee17622875 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Calling delete_port for f790fbae-e681-4e01-b1a4-67513d491300 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:14:51.069903 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6e791f82-f67c-4f31-8fe4-dadda29f9949 req-d5b85f2f-0ed4-4cd2-aeef-a85dca4b96d7 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/security-groups?id=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752268 Nov 08 04:14:51.283009 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-e667fc64-c538-49ab-9feb-7dee17622875 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:51.311401 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e667fc64-c538-49ab-9feb-7dee17622875 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Pushing event deleted for resources: {'Port': ['ID=f790fbae-e681-4e01-b1a4-67513d491300,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:51.324300 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['f790fbae-e681-4e01-b1a4-67513d491300'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:14:51.352505 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-e667fc64-c538-49ab-9feb-7dee17622875 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] No DVR routers for this DVR port f790fbae-e681-4e01-b1a4-67513d491300 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:14:51.356847 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-e667fc64-c538-49ab-9feb-7dee17622875 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:51.360384 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-594a15fa-00e1-426f-a8d3-255bbae4d5b5 req-e667fc64-c538-49ab-9feb-7dee17622875 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.16 "DELETE /v2.0/ports/f790fbae-e681-4e01-b1a4-67513d491300 HTTP/1.1" status: 204 len: 173 time: 0.6057460 Nov 08 04:14:51.360854 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dda4312d-16a9-4d15-9482-a296b62c88c1', 'name': 'network-vif-deleted', 'tag': 'f790fbae-e681-4e01-b1a4-67513d491300'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:14:51.363091 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f25adb2f-597e-45b0-8af3-66022094b3fd" -d '{"events": [{"server_uuid": "dda4312d-16a9-4d15-9482-a296b62c88c1", "name": "network-vif-deleted", "tag": "f790fbae-e681-4e01-b1a4-67513d491300"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:14:51.403017 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:14:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a70ce8d0-4dc0-4162-a44b-fa32ba8f2aa4 x-openstack-request-id: req-a70ce8d0-4dc0-4162-a44b-fa32ba8f2aa4 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:14:51.403371 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dda4312d-16a9-4d15-9482-a296b62c88c1", "name": "network-vif-deleted", "tag": "f790fbae-e681-4e01-b1a4-67513d491300", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:14:51.403689 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-a70ce8d0-4dc0-4162-a44b-fa32ba8f2aa4 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:14:51.404144 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dda4312d-16a9-4d15-9482-a296b62c88c1', 'name': 'network-vif-deleted', 'tag': 'f790fbae-e681-4e01-b1a4-67513d491300', 'status': 'completed', 'code': 200} Nov 08 04:14:51.605830 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54582) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:51.694977 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [req-85e01bd0-40ee-4669-9392-311a359b0780 req-d953f8a5-36ca-43a7-b1e4-43e1f43250b9 service neutron] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:14:51.695973 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85e01bd0-40ee-4669-9392-311a359b0780 req-d953f8a5-36ca-43a7-b1e4-43e1f43250b9 service neutron] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054047 Nov 08 04:14:51.711761 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8ebd12a5-04d5-4b64-9f2a-be30a18b76f0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:51.787075 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8ebd12a5-04d5-4b64-9f2a-be30a18b76f0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:51.860300 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8ebd12a5-04d5-4b64-9f2a-be30a18b76f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:51.899976 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ebd12a5-04d5-4b64-9f2a-be30a18b76f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f82daf7-5c5c-46af-830e-5f08f47e3023,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:51.905421 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-8ebd12a5-04d5-4b64-9f2a-be30a18b76f0 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=2b693c7876d24ba5b5bdef6345951e97&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2984600 Nov 08 04:14:51.907212 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54590) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:51.956856 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d95ca3-6fc4-4cc3-9ec0-c11d26bbbd81 req-87f637a3-5d82-4741-87ee-c9ee19d32615 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:51.964368 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e9d95ca3-6fc4-4cc3-9ec0-c11d26bbbd81 req-87f637a3-5d82-4741-87ee-c9ee19d32615 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0695167 Nov 08 04:14:51.978801 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d6cd2f4f-982a-4c91-a91b-75cbe444d2e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:52.003681 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d6cd2f4f-982a-4c91-a91b-75cbe444d2e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:52.039613 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e9d95ca3-6fc4-4cc3-9ec0-c11d26bbbd81 req-3a3d8253-8c4c-4866-ace6-1b7c4335d703 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0741134 Nov 08 04:14:52.075472 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279d841d-cc6a-46a1-af39-d2dcbcf35af7 req-5468f62f-2bb4-45b0-ae61-2aee1385d020 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:52.083000 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-279d841d-cc6a-46a1-af39-d2dcbcf35af7 req-5468f62f-2bb4-45b0-ae61-2aee1385d020 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.1043127 Nov 08 04:14:52.130528 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-279d841d-cc6a-46a1-af39-d2dcbcf35af7 req-4637b6cc-af3c-40c4-8174-7570e24805d0 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425882 Nov 08 04:14:52.153511 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d6cd2f4f-982a-4c91-a91b-75cbe444d2e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:52.156492 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d6cd2f4f-982a-4c91-a91b-75cbe444d2e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:52.158466 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-d6cd2f4f-982a-4c91-a91b-75cbe444d2e3 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/9f82daf7-5c5c-46af-830e-5f08f47e3023 HTTP/1.1" status: 204 len: 168 time: 0.2492771 Nov 08 04:14:52.170810 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cd2f4f-982a-4c91-a91b-75cbe444d2e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f82daf7-5c5c-46af-830e-5f08f47e3023,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:52.253962 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85fb25fd-92eb-4c37-a1e6-4aa81359189f req-ca69f70d-97eb-4a6b-a639-9219d046463f tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.0373268 Nov 08 04:14:52.455503 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1892138-47b2-4f26-8360-9bacdab8eb10 req-45b16555-d58a-4e6e-b101-212419a3e8db tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:52.457266 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f1892138-47b2-4f26-8360-9bacdab8eb10 req-45b16555-d58a-4e6e-b101-212419a3e8db tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0577414 Nov 08 04:14:52.520954 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f1892138-47b2-4f26-8360-9bacdab8eb10 req-007c7f01-c765-427f-8256-d5ec50ae4357 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0569732 Nov 08 04:14:52.824367 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54634) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:52.906923 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-bf6b7860-174f-4e58-b06d-2b522c191a5a service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0813882 Nov 08 04:14:52.915598 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-4bc34124-9143-4d0f-8a13-ec5cc3e6733a service neutron] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101664) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:14:52.916549 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-4bc34124-9143-4d0f-8a13-ec5cc3e6733a service neutron] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048978 Nov 08 04:14:53.256677 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be74e242-6377-497c-ac12-477bd4955021 req-7b76cf5c-c437-4bca-92a4-13a2dd870b48 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:53.258261 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be74e242-6377-497c-ac12-477bd4955021 req-7b76cf5c-c437-4bca-92a4-13a2dd870b48 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0494742 Nov 08 04:14:53.307888 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be74e242-6377-497c-ac12-477bd4955021 req-0b640a3a-8aab-4cbf-879e-2a35ec58b353 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435479 Nov 08 04:14:53.352878 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d429637b-83b1-41bb-8c78-3391e2c9949b req-e8be911f-7986-4537-a465-1528b0410991 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.0287490 Nov 08 04:14:53.680656 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-114b7415-740e-4f90-936c-819febd2ee8f req-053343bc-3bcb-4652-a642-c0e6568df255 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:53.682010 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-114b7415-740e-4f90-936c-819febd2ee8f req-053343bc-3bcb-4652-a642-c0e6568df255 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0476432 Nov 08 04:14:53.731070 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-114b7415-740e-4f90-936c-819febd2ee8f req-4dfe0ad5-ecdb-4117-8721-0f4f98230fad tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433664 Nov 08 04:14:54.153737 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device e6483e56-c377-4575-bd34-b26a5c2bf382 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:14:54.216434 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:54.406802 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-0f4dc037-daca-4461-9f3b-528e4ea8fb28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:54.410694 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-0f4dc037-daca-4461-9f3b-528e4ea8fb28 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 1098 time: 0.0511553 Nov 08 04:14:54.740536 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ef0b7514-2ed0-481a-968d-c2494d19daee req-8cbd77b3-6df1-4619-85fb-a1b2b3af8054 tempest-AttachVolumeNegativeTest-1474511757 tempest-AttachVolumeNegativeTest-1474511757-project] 10.222.0.21 "GET /v2.0/ports?device_id=dda4312d-16a9-4d15-9482-a296b62c88c1 HTTP/1.1" status: 200 len: 210 time: 0.2927728 Nov 08 04:14:54.776227 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a1a195c-a29e-4e31-8c9b-209e6ba64d2e req-a6602c99-c8d7-4363-8050-5f28ae5de07e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:54.777775 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a1a195c-a29e-4e31-8c9b-209e6ba64d2e req-a6602c99-c8d7-4363-8050-5f28ae5de07e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.3414166 Nov 08 04:14:54.803419 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-3c39c849-5b6d-4beb-82fa-a7a8ec9e4f08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:54.804846 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-3c39c849-5b6d-4beb-82fa-a7a8ec9e4f08 service neutron] 10.222.0.16 "GET /v2.0/networks?id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f HTTP/1.1" status: 200 len: 912 time: 0.3785501 Nov 08 04:14:54.868309 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a1a195c-a29e-4e31-8c9b-209e6ba64d2e req-60f12c89-f9d8-41f5-ac5f-2bbcd493136b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0810304 Nov 08 04:14:54.937706 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0d73c52-0ef8-4b0e-aa94-a8ec2cf96dd1 req-bf706cc7-0887-4d34-9d36-dc9a93982989 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:54.939224 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b0d73c52-0ef8-4b0e-aa94-a8ec2cf96dd1 req-bf706cc7-0887-4d34-9d36-dc9a93982989 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1268940 Nov 08 04:14:54.946519 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-7c2a80d4-de21-4aec-b39c-d6184dbd36af service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d997f4bb-f698-4538-b9ae-f08bec1d6ff6 HTTP/1.1" status: 200 len: 1000 time: 0.0876741 Nov 08 04:14:55.025099 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b0d73c52-0ef8-4b0e-aa94-a8ec2cf96dd1 req-80e08d44-c1a4-4544-9a92-6aeeefabaf17 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0779607 Nov 08 04:14:55.026623 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-9d099356-dc0c-4fbe-bd8f-dd91c7183015 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:55.027952 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-9d099356-dc0c-4fbe-bd8f-dd91c7183015 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=1158e941-c129-49d0-9b8b-ba72d0ef6717 HTTP/1.1" status: 200 len: 850 time: 0.0743053 Nov 08 04:14:55.079522 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-b0498950-c984-4ee0-9abe-77977e9bf5c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:55.081569 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-b0498950-c984-4ee0-9abe-77977e9bf5c4 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0439661 Nov 08 04:14:55.171763 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-486d422e-e17f-40bb-bff8-2fbabc207153 service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818517 Nov 08 04:14:55.265782 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ae1ef0b-b5af-41fa-abbb-b3996421e481 req-41da986a-d887-4688-94b4-5af18cba2876 service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860476 Nov 08 04:14:55.816284 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 54698) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:55.872088 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_v2 [None req-a68f06a6-dc30-4777-a41c-67babf6ce52f admin admin] Deleting subnet 59ccbcae-2516-4cc7-9077-478845e3e1f2 {{(pid=101665) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:14:55.876285 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a68f06a6-dc30-4777-a41c-67babf6ce52f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:55.913747 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a68f06a6-dc30-4777-a41c-67babf6ce52f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4636238'] for subnet, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:55.970462 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a68f06a6-dc30-4777-a41c-67babf6ce52f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:56.052158 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42add351-d233-4ddd-b3c6-82878fba3fff req-2a058447-4505-4c83-a28f-4f3711f8102b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:56.053803 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-42add351-d233-4ddd-b3c6-82878fba3fff req-2a058447-4505-4c83-a28f-4f3711f8102b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0951016 Nov 08 04:14:56.111694 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-42add351-d233-4ddd-b3c6-82878fba3fff req-01e5653c-27b4-4f6d-bc14-dba00a49bde1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488186 Nov 08 04:14:56.180573 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04829089-b9f8-4845-8511-2226cd836234 req-e735eba5-28b0-4d1b-b7ac-5e1516474310 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:56.188407 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-04829089-b9f8-4845-8511-2226cd836234 req-e735eba5-28b0-4d1b-b7ac-5e1516474310 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0737679 Nov 08 04:14:56.191759 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a68f06a6-dc30-4777-a41c-67babf6ce52f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6273036', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4372241'] for subnet, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:56.236721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a68f06a6-dc30-4777-a41c-67babf6ce52f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=59ccbcae-2516-4cc7-9077-478845e3e1f2,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:56.241433 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a68f06a6-dc30-4777-a41c-67babf6ce52f admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:56.247831 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-a68f06a6-dc30-4777-a41c-67babf6ce52f admin admin] 10.222.0.21 "DELETE /v2.0/subnets/59ccbcae-2516-4cc7-9077-478845e3e1f2 HTTP/1.1" status: 204 len: 168 time: 0.4276125 Nov 08 04:14:56.249279 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 54712) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:56.316934 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-04829089-b9f8-4845-8511-2226cd836234 req-44bc7b28-67ca-491e-a94a-472bb8e3c7cf tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1277070 Nov 08 04:14:56.337461 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:56.430725 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:56.452310 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1516eeae-19de-448e-9ebd-952b54f99dcc']}} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:56.465832 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6af2a9a8-7c62-4511-940f-bdb70a610241') {'for_net_delete': True} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:56.466310 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6af2a9a8-7c62-4511-940f-bdb70a610241') {} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:14:56.478387 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4636247'] for segment, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:56.492532 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:56.499533 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] Releasing vlan 167 on physical network physnet1 to pool {{(pid=101665) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:14:56.500051 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6273258'] for segment, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: Traceback (most recent call last): Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: timer() Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: cb(*args, **kw) Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: return func(*args, **kwargs) Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: self._notify() Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: self.callback(batched_events) Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: event.method(event) Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: return f(self, *a, **k) Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._get(url).json() Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: return self.request(url, 'GET', **kwargs) Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:14:56.502537 dv-cinder-783643-4-iscsi neutron-server[101665]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:14:56.643495 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:56.649217 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:56.654303 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] 10.222.0.21 "DELETE /v2.0/networks/1516eeae-19de-448e-9ebd-952b54f99dcc HTTP/1.1" status: 204 len: 168 time: 0.4033585 Nov 08 04:14:56.664197 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0980bbe9-8586-4591-a6c7-6fadc79438c7 admin admin] Pushing event deleted for resources: {'Network': ['ID=1516eeae-19de-448e-9ebd-952b54f99dcc,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:57.116795 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 54716) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:57.160273 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-36945470-c3b6-4bb0-b3e9-9f1c9179c141 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=f3ecedce4bce4764a6bd2e0cc60c4955&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0422575 Nov 08 04:14:57.163072 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 54722) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:14:57.289587 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0a518b72-1bc7-431f-ab4e-eb8e177c60d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:57.353441 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0a518b72-1bc7-431f-ab4e-eb8e177c60d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:57.357367 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-4d3af973-495d-4672-bda6-c0d244ed6cc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:57.359146 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-4d3af973-495d-4672-bda6-c0d244ed6cc4 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe&tenant_id=0efb8c7b359746668b199d14191e3f09 HTTP/1.1" status: 200 len: 1096 time: 0.1668944 Nov 08 04:14:57.394606 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781ad6ab-0617-43d9-919c-1defa944de8a req-2bb3539c-496b-4087-8006-4c292eb26c11 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:57.396096 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-781ad6ab-0617-43d9-919c-1defa944de8a req-2bb3539c-496b-4087-8006-4c292eb26c11 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.1318982 Nov 08 04:14:57.488690 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-d6cb4cb3-c0e4-4cff-846f-77c780786df4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:57.490242 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-d6cb4cb3-c0e4-4cff-846f-77c780786df4 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 1096 time: 0.0891044 Nov 08 04:14:57.501009 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-781ad6ab-0617-43d9-919c-1defa944de8a req-c31a9dc7-9540-4986-ac06-a44dd2feb079 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0885000 Nov 08 04:14:57.640575 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0a518b72-1bc7-431f-ab4e-eb8e177c60d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:57.643190 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0a518b72-1bc7-431f-ab4e-eb8e177c60d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:14:57.644312 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-0a518b72-1bc7-431f-ab4e-eb8e177c60d6 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/55b8c5a9-78a6-4ab9-b1d5-41b6358763ed HTTP/1.1" status: 204 len: 168 time: 0.4803085 Nov 08 04:14:57.691617 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a518b72-1bc7-431f-ab4e-eb8e177c60d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=55b8c5a9-78a6-4ab9-b1d5-41b6358763ed,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:14:57.749817 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37e7030b-da55-4ddc-ae23-ec53067201d9 req-57135f18-28b6-4471-852c-0e71bd5b21d8 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:57.751351 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-37e7030b-da55-4ddc-ae23-ec53067201d9 req-57135f18-28b6-4471-852c-0e71bd5b21d8 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1791017 Nov 08 04:14:57.759741 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238f2e4b-8e0b-41fd-8ced-8981e4eaa98d req-a3f835c6-7ea7-48a3-8103-8d74782b07d8 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:57.761364 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-238f2e4b-8e0b-41fd-8ced-8981e4eaa98d req-a3f835c6-7ea7-48a3-8103-8d74782b07d8 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.1848955 Nov 08 04:14:57.763789 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-6def19d1-c77f-4b9f-9af4-0fa17064a09a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:57.765079 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-6def19d1-c77f-4b9f-9af4-0fa17064a09a service neutron] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 918 time: 0.2631471 Nov 08 04:14:57.900120 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-37e7030b-da55-4ddc-ae23-ec53067201d9 req-95157b76-19e1-40fc-815c-2365c88767a3 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1376708 Nov 08 04:14:57.901970 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-5b053abe-3689-44d9-97b7-efa633d519f6 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e6483e56-c377-4575-bd34-b26a5c2bf382 HTTP/1.1" status: 200 len: 998 time: 0.1223238 Nov 08 04:14:57.909228 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-238f2e4b-8e0b-41fd-8ced-8981e4eaa98d req-824c889a-4fd3-4818-bb70-9bcfa2458a0f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1326630 Nov 08 04:14:57.957825 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-9cac833b-068f-4203-b9ad-20d7b898243e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:57.959330 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-9cac833b-068f-4203-b9ad-20d7b898243e service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.0491984 Nov 08 04:14:58.009875 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-3045a8ab-f378-47c7-a336-3248d83560a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:58.011451 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-3045a8ab-f378-47c7-a336-3248d83560a0 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0442014 Nov 08 04:14:58.123623 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-d28811b3-f936-4154-8602-80760994c292 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1012671 Nov 08 04:14:58.183739 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device f790fbae-e681-4e01-b1a4-67513d491300 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:14:58.222985 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: f790fbae-e681-4e01-b1a4-67513d491300 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:14:58.223744 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device f790fbae-e681-4e01-b1a4-67513d491300 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:14:58.243591 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-323236fb-f3d3-4c66-9ef7-317bc5c6f08f req-c1d09a6d-7722-462c-a1de-5d6fa2732a12 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1070542 Nov 08 04:14:58.648738 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26193f6d-3efa-41dc-89cf-766aeff6deb5 req-dda6728b-ce92-4bd4-8468-417bb1cd7894 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:58.655078 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-26193f6d-3efa-41dc-89cf-766aeff6deb5 req-dda6728b-ce92-4bd4-8468-417bb1cd7894 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0709248 Nov 08 04:14:58.702473 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-26193f6d-3efa-41dc-89cf-766aeff6deb5 req-3a917a78-2924-4762-b79a-388b68e0850d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449984 Nov 08 04:14:59.046854 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d940c79-b324-4bda-abea-45b69623b3d7 req-63f32464-1283-420b-8158-4d354d7cd894 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:59.049523 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9d940c79-b324-4bda-abea-45b69623b3d7 req-63f32464-1283-420b-8158-4d354d7cd894 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0664403 Nov 08 04:14:59.103323 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9d940c79-b324-4bda-abea-45b69623b3d7 req-0886e539-a4a9-45bf-8ead-0e0db4f07a4d tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481844 Nov 08 04:14:59.848723 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92934c86-69d4-48e9-a263-aaaf14f3ea43 req-79250d22-1563-4023-8901-b73908e78c33 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:14:59.850904 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92934c86-69d4-48e9-a263-aaaf14f3ea43 req-79250d22-1563-4023-8901-b73908e78c33 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0502534 Nov 08 04:14:59.912028 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92934c86-69d4-48e9-a263-aaaf14f3ea43 req-b35547d4-b1d4-4694-8f9b-a9aa4535929e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494728 Nov 08 04:15:00.220708 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f2aec3-06c9-4b7c-8911-10e23f4b2c7d req-81392497-1a54-4976-979b-492f72f0f3f2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:00.222355 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-93f2aec3-06c9-4b7c-8911-10e23f4b2c7d req-81392497-1a54-4976-979b-492f72f0f3f2 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0522370 Nov 08 04:15:00.275455 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-93f2aec3-06c9-4b7c-8911-10e23f4b2c7d req-3fe3d571-4712-4534-b0f2-f9502a734379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471468 Nov 08 04:15:00.429873 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-edd30469-0266-4945-80d2-25d94c9e9049 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:00.431658 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-edd30469-0266-4945-80d2-25d94c9e9049 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.16 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 945 time: 0.0513973 Nov 08 04:15:00.539358 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-7f48ad88-f6d2-4c50-8660-6ea04a504b5e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Deleting port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:15:00.539798 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-7f48ad88-f6d2-4c50-8660-6ea04a504b5e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:00.649535 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-7f48ad88-f6d2-4c50-8660-6ea04a504b5e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] For port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:00.650027 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-7f48ad88-f6d2-4c50-8660-6ea04a504b5e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:00.666135 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-7f48ad88-f6d2-4c50-8660-6ea04a504b5e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Calling delete_port for 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:15:00.867968 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-7f48ad88-f6d2-4c50-8660-6ea04a504b5e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:00.902969 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f48ad88-f6d2-4c50-8660-6ea04a504b5e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Pushing event deleted for resources: {'Port': ['ID=4e88411d-7ee7-4112-84b9-3f6a87ffd8e6,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:00.915742 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['4bc6cc8c-782d-4718-85b4-81156f4a2000', '4e88411d-7ee7-4112-84b9-3f6a87ffd8e6'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:15:00.961175 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-7f48ad88-f6d2-4c50-8660-6ea04a504b5e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] No DVR routers for this DVR port 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:15:00.964852 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-7f48ad88-f6d2-4c50-8660-6ea04a504b5e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:00.969658 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d3214d8-279c-4674-8962-7f9c7d8ec241 req-7f48ad88-f6d2-4c50-8660-6ea04a504b5e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.16 "DELETE /v2.0/ports/4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 HTTP/1.1" status: 204 len: 173 time: 0.5287447 Nov 08 04:15:00.970352 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '63ce1fee-21b7-44fe-8e44-78d58a2f9174', 'name': 'network-vif-deleted', 'tag': '4e88411d-7ee7-4112-84b9-3f6a87ffd8e6'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:15:00.976163 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-411a8c83-0ab2-4940-8eb3-270610b7d890" -d '{"events": [{"server_uuid": "63ce1fee-21b7-44fe-8e44-78d58a2f9174", "name": "network-vif-deleted", "tag": "4e88411d-7ee7-4112-84b9-3f6a87ffd8e6"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:15:01.130780 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661658c6-aaf0-4ec1-8921-82ea9ed60b7c req-3e9f7822-fdbf-4c7e-ad9b-5925c6fe8cb7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:01.133432 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-661658c6-aaf0-4ec1-8921-82ea9ed60b7c req-3e9f7822-fdbf-4c7e-ad9b-5925c6fe8cb7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0967019 Nov 08 04:15:01.300632 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-661658c6-aaf0-4ec1-8921-82ea9ed60b7c req-c09cd3a8-8ed2-4747-87a5-dd0a5ea7ff8b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1318259 Nov 08 04:15:01.401181 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:15:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c566bbc3-6561-4212-a4d1-e0d90717bffd x-openstack-request-id: req-c566bbc3-6561-4212-a4d1-e0d90717bffd {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:15:01.401649 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "63ce1fee-21b7-44fe-8e44-78d58a2f9174", "name": "network-vif-deleted", "tag": "4e88411d-7ee7-4112-84b9-3f6a87ffd8e6", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:15:01.402059 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-c566bbc3-6561-4212-a4d1-e0d90717bffd {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:15:01.402930 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '63ce1fee-21b7-44fe-8e44-78d58a2f9174', 'name': 'network-vif-deleted', 'tag': '4e88411d-7ee7-4112-84b9-3f6a87ffd8e6', 'status': 'completed', 'code': 200} Nov 08 04:15:01.469560 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5cf91671-6077-41db-bd98-1b9bf7fd0ca5 req-557782f1-bb6e-4d6a-9939-2dbd1c48e7df tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=63ce1fee-21b7-44fe-8e44-78d58a2f9174 HTTP/1.1" status: 200 len: 210 time: 0.0267987 Nov 08 04:15:02.449458 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd7dc881-61eb-4229-b7b2-d6419e8f6584 req-a4a514f1-3773-4cec-9824-0767a92af3de tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:02.451213 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd7dc881-61eb-4229-b7b2-d6419e8f6584 req-a4a514f1-3773-4cec-9824-0767a92af3de tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0615177 Nov 08 04:15:02.530407 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd7dc881-61eb-4229-b7b2-d6419e8f6584 req-86c5d7e8-0e35-4921-b1c0-d3b52a50e508 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0721147 Nov 08 04:15:03.073022 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54830) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:03.117034 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac323bc8-6141-4247-aae4-46e6836ce20b req-8c6bfda3-e0db-4759-8122-2da4b66e0a40 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:03.118860 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac323bc8-6141-4247-aae4-46e6836ce20b req-8c6bfda3-e0db-4759-8122-2da4b66e0a40 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0643270 Nov 08 04:15:03.177952 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac323bc8-6141-4247-aae4-46e6836ce20b req-34e366c1-36bd-4d7f-8495-131c39807396 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533733 Nov 08 04:15:03.196480 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bdf47ebc-95c3-424d-a0aa-9a498a601209 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:03.281522 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bdf47ebc-95c3-424d-a0aa-9a498a601209 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:03.363661 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bdf47ebc-95c3-424d-a0aa-9a498a601209 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:03.410095 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-bdf47ebc-95c3-424d-a0aa-9a498a601209 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=5e7c21c9b6e04542884e72465a5088d2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3351607 Nov 08 04:15:03.410993 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdf47ebc-95c3-424d-a0aa-9a498a601209 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f39061f-4d8a-416c-bb5f-635b50f5cac7,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:03.412553 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 54834) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:03.467375 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-e0afdc7a-d5d1-49db-b40a-f274b11b6ab0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:03.491852 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-e0afdc7a-d5d1-49db-b40a-f274b11b6ab0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:03.640237 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-e0afdc7a-d5d1-49db-b40a-f274b11b6ab0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:03.643565 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-e0afdc7a-d5d1-49db-b40a-f274b11b6ab0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:03.644382 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-e0afdc7a-d5d1-49db-b40a-f274b11b6ab0 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/3f39061f-4d8a-416c-bb5f-635b50f5cac7 HTTP/1.1" status: 204 len: 168 time: 0.2286944 Nov 08 04:15:03.663442 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0afdc7a-d5d1-49db-b40a-f274b11b6ab0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f39061f-4d8a-416c-bb5f-635b50f5cac7,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:03.689445 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d617b3e0-347a-4a7f-9cf3-abb1bc98749f req-2a9ba665-1dab-457f-a2a0-54bf38aac3ed tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:03.692433 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d617b3e0-347a-4a7f-9cf3-abb1bc98749f req-2a9ba665-1dab-457f-a2a0-54bf38aac3ed tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0795319 Nov 08 04:15:03.756900 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d617b3e0-347a-4a7f-9cf3-abb1bc98749f req-ba586bd9-eafd-4e86-8707-2032687d901c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0533609 Nov 08 04:15:03.972690 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:15:04.202911 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:15:04.263100 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:15:04.263603 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 4e88411d-7ee7-4112-84b9-3f6a87ffd8e6 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:15:04.337829 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89887657-7b81-461b-ba07-6a8b94370147 req-4d3b2efd-c79c-4f52-8866-233da6e8379a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:04.339529 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-89887657-7b81-461b-ba07-6a8b94370147 req-4d3b2efd-c79c-4f52-8866-233da6e8379a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0546989 Nov 08 04:15:04.398549 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-89887657-7b81-461b-ba07-6a8b94370147 req-8397c571-7a8b-4d9e-8e2c-a8a8c9219619 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513954 Nov 08 04:15:04.985782 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf65204-200b-4a93-805b-37724fa66181 req-144c27b5-e3a2-4a57-9bb8-1c5cc7ed3096 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:04.992737 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-caf65204-200b-4a93-805b-37724fa66181 req-144c27b5-e3a2-4a57-9bb8-1c5cc7ed3096 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.1256282 Nov 08 04:15:05.091461 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-caf65204-200b-4a93-805b-37724fa66181 req-3f0ef540-4840-4b6a-8d7f-4f5ca99ab82c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0908337 Nov 08 04:15:05.626214 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7baaefca-bdc6-4401-9748-74900e772c82 req-e69c7828-0535-46bb-a261-69795a6bfaac tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:05.628716 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7baaefca-bdc6-4401-9748-74900e772c82 req-e69c7828-0535-46bb-a261-69795a6bfaac tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0855305 Nov 08 04:15:05.718542 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7baaefca-bdc6-4401-9748-74900e772c82 req-54c19dc8-221f-4cbf-b041-305ba9a3df5f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0827904 Nov 08 04:15:06.297320 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1bbd3f-971f-48f9-84cf-dbd8a3ae5865 req-d54e1950-21e8-49fa-ba91-4135d7518999 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:06.298879 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4e1bbd3f-971f-48f9-84cf-dbd8a3ae5865 req-d54e1950-21e8-49fa-ba91-4135d7518999 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0795584 Nov 08 04:15:06.352885 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4e1bbd3f-971f-48f9-84cf-dbd8a3ae5865 req-cbeea082-ee41-4087-b0b3-c2a0882febb7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476518 Nov 08 04:15:06.944517 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e093cdd1-272c-4330-9372-523d59bfa60d req-c6617bdd-e908-4a3a-9f1f-00ae1320eedd tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:06.962922 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e093cdd1-272c-4330-9372-523d59bfa60d req-c6617bdd-e908-4a3a-9f1f-00ae1320eedd tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1358006 Nov 08 04:15:07.033758 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e093cdd1-272c-4330-9372-523d59bfa60d req-6cacb424-5e6a-4fef-9caf-f008ca6024cf tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693128 Nov 08 04:15:07.527894 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868de5a6-644d-4024-a575-4fcfca8e4dc8 req-f4ae62aa-3a1d-4281-829d-182e633663b8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:07.536324 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-868de5a6-644d-4024-a575-4fcfca8e4dc8 req-f4ae62aa-3a1d-4281-829d-182e633663b8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0610127 Nov 08 04:15:07.610219 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-868de5a6-644d-4024-a575-4fcfca8e4dc8 req-831459ae-c577-4356-b7e8-8f25ff354c9a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0726326 Nov 08 04:15:07.851012 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 54946) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:08.026442 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b2697886-5fca-4245-925a-6cf1f8f6a5a2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:08.200579 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b2697886-5fca-4245-925a-6cf1f8f6a5a2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:08.223197 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9bc978c-2974-489c-8a7c-fc76b46a8ccf req-06f8eccf-9a40-4f99-87bc-6d2a7fd48670 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:08.236698 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c9bc978c-2974-489c-8a7c-fc76b46a8ccf req-06f8eccf-9a40-4f99-87bc-6d2a7fd48670 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0735171 Nov 08 04:15:08.375000 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c9bc978c-2974-489c-8a7c-fc76b46a8ccf req-9caf4850-c1fb-44c7-8afe-11fa97624d33 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1358800 Nov 08 04:15:08.762951 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c55195b-092b-4cd2-bf6a-72f19f657d6c req-32316234-578a-4a3a-8fb7-9e7a680a4cc8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:08.770942 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c55195b-092b-4cd2-bf6a-72f19f657d6c req-32316234-578a-4a3a-8fb7-9e7a680a4cc8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0700352 Nov 08 04:15:08.772732 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b2697886-5fca-4245-925a-6cf1f8f6a5a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:08.810133 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2697886-5fca-4245-925a-6cf1f8f6a5a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb5b1d49-d3a2-4165-9f12-7c2eed94d3ea,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:08.911338 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b2697886-5fca-4245-925a-6cf1f8f6a5a2 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=b4854fd5e7f14951884f32f87117d8e9&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0551362 Nov 08 04:15:08.911677 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54958) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:08.930611 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c55195b-092b-4cd2-bf6a-72f19f657d6c req-db475e86-307c-40b2-a400-f66f66da6666 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1544790 Nov 08 04:15:09.006718 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-684e7f83-820b-40d8-bde9-f9fd8d4d4b04 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:09.052445 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-684e7f83-820b-40d8-bde9-f9fd8d4d4b04 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:09.245181 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-684e7f83-820b-40d8-bde9-f9fd8d4d4b04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:09.248402 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-684e7f83-820b-40d8-bde9-f9fd8d4d4b04 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:09.250914 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-684e7f83-820b-40d8-bde9-f9fd8d4d4b04 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/fb5b1d49-d3a2-4165-9f12-7c2eed94d3ea HTTP/1.1" status: 204 len: 168 time: 0.3380384 Nov 08 04:15:09.263074 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-684e7f83-820b-40d8-bde9-f9fd8d4d4b04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb5b1d49-d3a2-4165-9f12-7c2eed94d3ea,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:09.538395 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e0f3f6-698f-4cd0-955f-1a5e73145e1f req-45909552-9e6d-4458-a3bd-5cc8ac6a1984 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:09.540006 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8e0f3f6-698f-4cd0-955f-1a5e73145e1f req-45909552-9e6d-4458-a3bd-5cc8ac6a1984 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0769167 Nov 08 04:15:09.621057 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8e0f3f6-698f-4cd0-955f-1a5e73145e1f req-882391af-9dad-40f4-a489-0a3ee38f8473 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706122 Nov 08 04:15:10.067971 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ae2449-e523-4411-87b9-fcab16ce15ea req-f2dea11a-6567-43ce-b959-0d2d1e2806fc tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:10.069223 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-73ae2449-e523-4411-87b9-fcab16ce15ea req-f2dea11a-6567-43ce-b959-0d2d1e2806fc tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0496278 Nov 08 04:15:10.120174 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-73ae2449-e523-4411-87b9-fcab16ce15ea req-44190fdb-c343-464f-829b-9bcf9bfc8bb0 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451148 Nov 08 04:15:10.310812 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 54972) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:10.324167 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-49eff5b7-ca7a-460c-a83a-341e491f9cfc admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:10.431585 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-49eff5b7-ca7a-460c-a83a-341e491f9cfc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:10.501608 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-49eff5b7-ca7a-460c-a83a-341e491f9cfc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:10.561930 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 54978) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:10.562654 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-49eff5b7-ca7a-460c-a83a-341e491f9cfc admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=9195f00a979d4a4080a7e8714a0e2cbd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2500877 Nov 08 04:15:10.562956 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49eff5b7-ca7a-460c-a83a-341e491f9cfc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a812858-17b0-4fa5-a07f-a0ea90d84894,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:10.695095 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-73905da5-8341-481a-a0f0-7ede00faf6e1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:10.730089 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-73905da5-8341-481a-a0f0-7ede00faf6e1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:10.818021 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d510aeb-a3d9-4fa1-8d36-df2508828640 req-5d8b1317-7cd7-477c-aa3e-efb4737fe8c4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:10.821750 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6d510aeb-a3d9-4fa1-8d36-df2508828640 req-5d8b1317-7cd7-477c-aa3e-efb4737fe8c4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0814972 Nov 08 04:15:10.919667 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-73905da5-8341-481a-a0f0-7ede00faf6e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:10.922623 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-73905da5-8341-481a-a0f0-7ede00faf6e1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:10.926818 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-73905da5-8341-481a-a0f0-7ede00faf6e1 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/0a812858-17b0-4fa5-a07f-a0ea90d84894 HTTP/1.1" status: 204 len: 168 time: 0.3596575 Nov 08 04:15:10.930135 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6d510aeb-a3d9-4fa1-8d36-df2508828640 req-c3222d16-6c9b-4351-a42f-0327be25294a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0935683 Nov 08 04:15:10.942660 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73905da5-8341-481a-a0f0-7ede00faf6e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a812858-17b0-4fa5-a07f-a0ea90d84894,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:11.349200 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6635a569-66f2-48d8-bd38-19b1e651e943 req-c49e954b-c0ca-4905-9c3d-7af804234ee0 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:11.350788 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6635a569-66f2-48d8-bd38-19b1e651e943 req-c49e954b-c0ca-4905-9c3d-7af804234ee0 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.1201541 Nov 08 04:15:11.457703 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6635a569-66f2-48d8-bd38-19b1e651e943 req-b0960b90-d3cb-452d-95d6-b197e177602e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0931194 Nov 08 04:15:12.132787 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ade537c0-4979-47e8-87fa-77dec706cfaf req-15df5d8b-0310-47f5-a971-4a9fe598d8d6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:12.140403 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ade537c0-4979-47e8-87fa-77dec706cfaf req-15df5d8b-0310-47f5-a971-4a9fe598d8d6 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0854089 Nov 08 04:15:12.215801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ade537c0-4979-47e8-87fa-77dec706cfaf req-497b684d-780e-45eb-8c8c-4e3398dc378a tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0746126 Nov 08 04:15:12.690791 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c77dcb-cc1b-4311-9ea0-2e110e6bf7ad req-4dd66ce3-6c20-4d73-9c44-4c5944259019 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:12.700165 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-72c77dcb-cc1b-4311-9ea0-2e110e6bf7ad req-4dd66ce3-6c20-4d73-9c44-4c5944259019 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.1323879 Nov 08 04:15:12.719294 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-64cd5c6a-0b9a-4aff-b8c3-e4ccd8f2d764 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:12.802083 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-72c77dcb-cc1b-4311-9ea0-2e110e6bf7ad req-c985f4dc-dc3f-41e7-820f-0ae54c06d9e5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1003876 Nov 08 04:15:13.453548 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88883d83-75e2-4d64-8ceb-4cf1b28d5b5a req-8198fd4b-c8e8-4942-8446-2a99d67a2516 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:13.461922 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-88883d83-75e2-4d64-8ceb-4cf1b28d5b5a req-8198fd4b-c8e8-4942-8446-2a99d67a2516 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.1147978 Nov 08 04:15:13.511564 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-88883d83-75e2-4d64-8ceb-4cf1b28d5b5a req-f8335d75-eb21-42b9-bb24-4cccbdac0551 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480266 Nov 08 04:15:14.013013 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26f9222-2440-4332-820e-43753ef0889b req-77c45e6f-73f7-409f-8cb7-db61b6ec72de tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:14.014728 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f26f9222-2440-4332-820e-43753ef0889b req-77c45e6f-73f7-409f-8cb7-db61b6ec72de tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.1049001 Nov 08 04:15:14.123903 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f26f9222-2440-4332-820e-43753ef0889b req-40833f4b-431f-432a-82cf-3ce01e94bc70 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1003578 Nov 08 04:15:14.700986 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d192775-e2fb-48c4-bb44-731ced5fe1ec req-886f7f5e-7ed6-4df8-82ae-e43952d45d05 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:14.709579 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6d192775-e2fb-48c4-bb44-731ced5fe1ec req-886f7f5e-7ed6-4df8-82ae-e43952d45d05 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0931983 Nov 08 04:15:14.788912 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6d192775-e2fb-48c4-bb44-731ced5fe1ec req-5db05d1d-e25c-4c3b-8dd7-2e273dd989dd tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758379 Nov 08 04:15:15.144603 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55060) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:15.154004 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-10fe9907-d660-4319-8904-ae670c30078b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:15.335112 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ae0cd44-47f8-449c-95ff-c34544d97c2a req-4b708961-761f-47f0-b0c7-d5c1c4ebfbb1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:15.345427 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0ae0cd44-47f8-449c-95ff-c34544d97c2a req-4b708961-761f-47f0-b0c7-d5c1c4ebfbb1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0860674 Nov 08 04:15:15.375292 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-25c86c53-8be6-4319-9f6a-27d685fefec5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:15.484349 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0ae0cd44-47f8-449c-95ff-c34544d97c2a req-1d10b3e5-7454-4147-9330-de7a94c4bf2e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1289759 Nov 08 04:15:15.677873 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-25c86c53-8be6-4319-9f6a-27d685fefec5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:15.954566 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027c5a9d-77a9-4d97-bf4e-78127295be8b req-176fae22-8170-453e-a6f8-c403089233b3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:15.963391 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-027c5a9d-77a9-4d97-bf4e-78127295be8b req-176fae22-8170-453e-a6f8-c403089233b3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0887156 Nov 08 04:15:16.023500 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-027c5a9d-77a9-4d97-bf4e-78127295be8b req-7304e9f2-4f81-4d5b-bd2c-95867f6c2b7f tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586042 Nov 08 04:15:16.056097 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-25c86c53-8be6-4319-9f6a-27d685fefec5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:16.079631 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:16.098913 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25c86c53-8be6-4319-9f6a-27d685fefec5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a744b5f5-e524-4307-9c7c-fa8ee5ef8234,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:16.105992 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-25c86c53-8be6-4319-9f6a-27d685fefec5 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=ae72c6f321264e6a9ebe39a7dc03870e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9578302 Nov 08 04:15:16.106975 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55072) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:16.191246 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3c4a1b9d-f9c9-4356-8279-d4b75eb0aaaf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:16.240978 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3c4a1b9d-f9c9-4356-8279-d4b75eb0aaaf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:16.427335 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3c4a1b9d-f9c9-4356-8279-d4b75eb0aaaf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:16.431247 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3c4a1b9d-f9c9-4356-8279-d4b75eb0aaaf admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:16.433102 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-3c4a1b9d-f9c9-4356-8279-d4b75eb0aaaf admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/a744b5f5-e524-4307-9c7c-fa8ee5ef8234 HTTP/1.1" status: 204 len: 168 time: 0.3253400 Nov 08 04:15:16.445757 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4a1b9d-f9c9-4356-8279-d4b75eb0aaaf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a744b5f5-e524-4307-9c7c-fa8ee5ef8234,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:16.720994 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c054f11-7e52-44b9-af8d-20bcb5d74c67 req-29890f86-a1b4-4713-b024-e17a175a3579 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:16.724223 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c054f11-7e52-44b9-af8d-20bcb5d74c67 req-29890f86-a1b4-4713-b024-e17a175a3579 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0805399 Nov 08 04:15:16.794128 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c054f11-7e52-44b9-af8d-20bcb5d74c67 req-2f35745f-27d0-4644-bbad-864abb01bc00 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0574722 Nov 08 04:15:17.155224 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-738878af-69bb-4d03-b8d8-9b82485ecc6b req-744d5348-de11-4c6c-8fdb-e86c4524d5d4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:17.156985 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-738878af-69bb-4d03-b8d8-9b82485ecc6b req-744d5348-de11-4c6c-8fdb-e86c4524d5d4 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0674441 Nov 08 04:15:17.234902 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55094) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:17.249276 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a02b31cd-a4e1-4128-bb83-3b4b96b9f441 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:17.343765 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a02b31cd-a4e1-4128-bb83-3b4b96b9f441 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:17.422222 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a02b31cd-a4e1-4128-bb83-3b4b96b9f441 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:17.473997 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-738878af-69bb-4d03-b8d8-9b82485ecc6b req-eb9d155a-cb8a-4380-a291-63bce68d5067 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3085110 Nov 08 04:15:17.475373 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a02b31cd-a4e1-4128-bb83-3b4b96b9f441 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41d93205-8c35-4f8d-aad3-ae382c18486b,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:17.505102 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a02b31cd-a4e1-4128-bb83-3b4b96b9f441 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=9c6df357652c428ba09a6be38aaccb3c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2606537 Nov 08 04:15:17.505890 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55096) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:17.574027 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-7bcf6e5a-8464-4fd6-938f-05fa450e72ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:17.601999 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-7bcf6e5a-8464-4fd6-938f-05fa450e72ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:17.612600 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:17.730065 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-7bcf6e5a-8464-4fd6-938f-05fa450e72ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:17.737312 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-7bcf6e5a-8464-4fd6-938f-05fa450e72ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:17.737312 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-7bcf6e5a-8464-4fd6-938f-05fa450e72ee admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/41d93205-8c35-4f8d-aad3-ae382c18486b HTTP/1.1" status: 204 len: 168 time: 0.2310896 Nov 08 04:15:17.762045 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bcf6e5a-8464-4fd6-938f-05fa450e72ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41d93205-8c35-4f8d-aad3-ae382c18486b,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:17.929920 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d7718b-d2ea-47f2-9974-7c3b083b7fe2 req-b6f2a0c3-fb40-42bc-a3f9-416fc3d8fe65 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:17.931389 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85d7718b-d2ea-47f2-9974-7c3b083b7fe2 req-b6f2a0c3-fb40-42bc-a3f9-416fc3d8fe65 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0476158 Nov 08 04:15:17.979190 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85d7718b-d2ea-47f2-9974-7c3b083b7fe2 req-f3bec499-2015-42d2-a88b-189adc962b4e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418613 Nov 08 04:15:18.370056 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:18.601138 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7da1531-a757-48b0-b65b-d824cc55cc59 req-1bc7b75c-a6a8-4aa7-aaa0-561d3e2e6bf5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:18.602675 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7da1531-a757-48b0-b65b-d824cc55cc59 req-1bc7b75c-a6a8-4aa7-aaa0-561d3e2e6bf5 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0516686 Nov 08 04:15:18.650607 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7da1531-a757-48b0-b65b-d824cc55cc59 req-fb76fed4-4763-4123-94d7-bb8119532dc3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420122 Nov 08 04:15:19.121262 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a786f8fc-c4e4-4386-86b6-25a903292a88 req-165b2bc5-1efb-4ef7-8d81-f408a1eb137f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:19.122815 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a786f8fc-c4e4-4386-86b6-25a903292a88 req-165b2bc5-1efb-4ef7-8d81-f408a1eb137f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0562479 Nov 08 04:15:19.170445 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a786f8fc-c4e4-4386-86b6-25a903292a88 req-fef53ecb-25cb-47f8-a8ef-aa6a54dcfaf5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412583 Nov 08 04:15:19.771241 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d16e9c0-4059-49f0-b4a5-077a105fb702 req-27edba67-ac16-437f-ab1a-a2f67da4d980 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:19.772914 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9d16e9c0-4059-49f0-b4a5-077a105fb702 req-27edba67-ac16-437f-ab1a-a2f67da4d980 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0571792 Nov 08 04:15:19.824453 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9d16e9c0-4059-49f0-b4a5-077a105fb702 req-ff48c7fd-e46a-458b-a758-bf2ec766658c tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453696 Nov 08 04:15:20.291880 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b4126b-d1da-4751-a0c0-24da03546ec7 req-790fe24b-16f4-4759-a4da-3a50159b112d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:20.293342 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92b4126b-d1da-4751-a0c0-24da03546ec7 req-790fe24b-16f4-4759-a4da-3a50159b112d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0498466 Nov 08 04:15:20.339235 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92b4126b-d1da-4751-a0c0-24da03546ec7 req-f3659f49-f2f1-4397-bb19-29c9e3043c71 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393686 Nov 08 04:15:20.938968 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a38252eb-9b3b-42a8-8f40-ec71a5695b7b req-230a8407-f3f9-44dc-a6be-55091cbbee48 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:20.940429 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a38252eb-9b3b-42a8-8f40-ec71a5695b7b req-230a8407-f3f9-44dc-a6be-55091cbbee48 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0472119 Nov 08 04:15:20.990066 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a38252eb-9b3b-42a8-8f40-ec71a5695b7b req-62f1d187-fddb-481e-aa49-12d6dc70f5ac tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436146 Nov 08 04:15:21.477580 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-310481fc-4037-4c39-a7d3-a69f67807f3d req-6730ea95-fc8b-468a-b47a-7e8a22c0e892 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:21.479091 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-310481fc-4037-4c39-a7d3-a69f67807f3d req-6730ea95-fc8b-468a-b47a-7e8a22c0e892 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0504243 Nov 08 04:15:21.553243 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-310481fc-4037-4c39-a7d3-a69f67807f3d req-0c8aeb36-17f6-4381-9a5e-52f77fb8ef21 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0678184 Nov 08 04:15:21.566425 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-d907b916-195e-42ad-a9ef-418772d187ca tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:21.567993 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-d907b916-195e-42ad-a9ef-418772d187ca tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.16 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0751512 Nov 08 04:15:21.668142 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55252) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:21.708363 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-c47f7982-1027-48cc-b21b-f55b4b2ae379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Deleting port 4bc6cc8c-782d-4718-85b4-81156f4a2000 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:15:21.711297 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-c47f7982-1027-48cc-b21b-f55b4b2ae379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:21.742808 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_v2 [None req-f8194a44-5cbb-4d6e-923c-3568403a1264 admin admin] Deleting subnet 8fce9f14-c9c6-47d9-9ea8-c6a5dedd5ca7 {{(pid=101665) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:15:21.776192 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f8194a44-5cbb-4d6e-923c-3568403a1264 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:21.824603 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f8194a44-5cbb-4d6e-923c-3568403a1264 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4636238'] for subnet, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:21.862668 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-c47f7982-1027-48cc-b21b-f55b4b2ae379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] For port 4bc6cc8c-782d-4718-85b4-81156f4a2000, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=4bc6cc8c-782d-4718-85b4-81156f4a2000,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:21.863024 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-c47f7982-1027-48cc-b21b-f55b4b2ae379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:21.883868 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-c47f7982-1027-48cc-b21b-f55b4b2ae379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Calling delete_port for 4bc6cc8c-782d-4718-85b4-81156f4a2000 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:15:21.890763 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f8194a44-5cbb-4d6e-923c-3568403a1264 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.051753 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f8194a44-5cbb-4d6e-923c-3568403a1264 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6273036', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4372241'] for subnet, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.077526 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8194a44-5cbb-4d6e-923c-3568403a1264 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8fce9f14-c9c6-47d9-9ea8-c6a5dedd5ca7,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:22.088811 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f8194a44-5cbb-4d6e-923c-3568403a1264 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.092512 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f8194a44-5cbb-4d6e-923c-3568403a1264 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/8fce9f14-c9c6-47d9-9ea8-c6a5dedd5ca7 HTTP/1.1" status: 204 len: 168 time: 0.4228506 Nov 08 04:15:22.094775 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55258) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:22.133939 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c23f590-e219-47f0-91cc-f7d8edfd632d req-d69d7c83-385c-4fd3-a552-70bc944670d3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:22.135345 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c23f590-e219-47f0-91cc-f7d8edfd632d req-d69d7c83-385c-4fd3-a552-70bc944670d3 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 945 time: 0.0598180 Nov 08 04:15:22.139918 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-c47f7982-1027-48cc-b21b-f55b4b2ae379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.167573 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.177086 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['4bc6cc8c-782d-4718-85b4-81156f4a2000'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:15:22.190290 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c47f7982-1027-48cc-b21b-f55b4b2ae379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Pushing event deleted for resources: {'Port': ['ID=4bc6cc8c-782d-4718-85b4-81156f4a2000,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:22.256315 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-c47f7982-1027-48cc-b21b-f55b4b2ae379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] No DVR routers for this DVR port 4bc6cc8c-782d-4718-85b4-81156f4a2000 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:15:22.259160 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-c47f7982-1027-48cc-b21b-f55b4b2ae379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.262428 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5a21e3a-70d4-46ef-89a0-1e241787e66c req-c47f7982-1027-48cc-b21b-f55b4b2ae379 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.16 "DELETE /v2.0/ports/4bc6cc8c-782d-4718-85b4-81156f4a2000 HTTP/1.1" status: 204 len: 173 time: 0.6851540 Nov 08 04:15:22.262886 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6ac78e1d-3043-41a2-9a5d-08f026444d81', 'name': 'network-vif-deleted', 'tag': '4bc6cc8c-782d-4718-85b4-81156f4a2000'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:15:22.265622 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c5fd0ba-f615-4a3d-ba78-d026d1f54841" -d '{"events": [{"server_uuid": "6ac78e1d-3043-41a2-9a5d-08f026444d81", "name": "network-vif-deleted", "tag": "4bc6cc8c-782d-4718-85b4-81156f4a2000"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:15:22.275380 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.287089 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c23f590-e219-47f0-91cc-f7d8edfd632d req-c1e4c945-53cd-43f7-9b9e-a483d21a9d6e tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/security-groups?id=62a05974-7d67-4e01-81d5-ecfb972cef00&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1433015 Nov 08 04:15:22.304580 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:15:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3987ff2a-53f3-48bb-b5f5-c7a26e56ca43 x-openstack-request-id: req-3987ff2a-53f3-48bb-b5f5-c7a26e56ca43 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:15:22.304918 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6ac78e1d-3043-41a2-9a5d-08f026444d81", "name": "network-vif-deleted", "tag": "4bc6cc8c-782d-4718-85b4-81156f4a2000", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:15:22.305699 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-3987ff2a-53f3-48bb-b5f5-c7a26e56ca43 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:15:22.305699 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6ac78e1d-3043-41a2-9a5d-08f026444d81', 'name': 'network-vif-deleted', 'tag': '4bc6cc8c-782d-4718-85b4-81156f4a2000', 'status': 'completed', 'code': 200} Nov 08 04:15:22.307657 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7']}} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:22.317461 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '352fab34-f426-4ea6-a0d5-2c5b84c3f901') {'for_net_delete': True} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:22.317746 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '352fab34-f426-4ea6-a0d5-2c5b84c3f901') {} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:22.328656 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6285915'] for segment, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.345407 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.352312 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] Releasing vlan 173 on physical network physnet1 to pool {{(pid=101664) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:15:22.352728 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5120795'] for segment, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: Traceback (most recent call last): Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: timer() Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: cb(*args, **kw) Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: return func(*args, **kwargs) Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: self._notify() Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: self.callback(batched_events) Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: event.method(event) Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: return f(self, *a, **k) Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._get(url).json() Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: return self.request(url, 'GET', **kwargs) Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:15:22.354373 dv-cinder-783643-4-iscsi neutron-server[101664]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:15:22.484972 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.490831 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.493955 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] 10.222.0.21 "DELETE /v2.0/networks/a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7 HTTP/1.1" status: 204 len: 168 time: 0.3981376 Nov 08 04:15:22.505173 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a210655-087d-45d7-b145-50ec0c8730c1 admin admin] Pushing event deleted for resources: {'Network': ['ID=a6f7dfe9-33ed-45fc-8eb7-59fffc0a2da7,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:22.689468 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a09e1bfc-e7a1-4626-83b7-638f6c2315bc req-414045af-a69c-4e9b-8683-2daabe3dc5b0 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:22.691566 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a09e1bfc-e7a1-4626-83b7-638f6c2315bc req-414045af-a69c-4e9b-8683-2daabe3dc5b0 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0567741 Nov 08 04:15:22.740099 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a09e1bfc-e7a1-4626-83b7-638f6c2315bc req-276e29b0-136a-4b49-9d0f-f83aece1df6c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423470 Nov 08 04:15:22.850905 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55270) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:22.889468 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-5ebf736e-fbca-4f7c-91e8-abc337ba8a1c admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=edc63d7a2a744b17a120c4d21149a2d0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0372632 Nov 08 04:15:22.891865 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55272) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:22.941150 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ac450477-6c3b-4897-ab50-012853a37f6a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:22.962376 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ac450477-6c3b-4897-ab50-012853a37f6a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:23.090608 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ac450477-6c3b-4897-ab50-012853a37f6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:23.093255 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ac450477-6c3b-4897-ab50-012853a37f6a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:23.094519 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-ac450477-6c3b-4897-ab50-012853a37f6a admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/7e01fc88-1e6e-4e50-bc53-6c52498c7510 HTTP/1.1" status: 204 len: 168 time: 0.2016425 Nov 08 04:15:23.102418 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac450477-6c3b-4897-ab50-012853a37f6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e01fc88-1e6e-4e50-bc53-6c52498c7510,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:23.258317 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-1f2e3bc9-0793-4256-b369-58ad8c80227e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1718587729&fields=id&tenant_id=aa58a6fe20a449858977c517ca68518b HTTP/1.1" status: 200 len: 267 time: 0.0430658 Nov 08 04:15:23.439114 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4e812604-5888-4f48-af52-6e3b429d3541 req-58b75a8a-ebe1-45d7-9d8c-69a51162ad17 tempest-ServerRescueNegativeTestJSON-1760756762 tempest-ServerRescueNegativeTestJSON-1760756762-project] 10.222.0.21 "GET /v2.0/ports?device_id=6ac78e1d-3043-41a2-9a5d-08f026444d81 HTTP/1.1" status: 200 len: 210 time: 0.0520267 Nov 08 04:15:23.453433 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-c1f17a7f-7161-4de5-b13d-b18a233beda5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:23.456975 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-c1f17a7f-7161-4de5-b13d-b18a233beda5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 812 time: 0.1917472 Nov 08 04:15:23.474644 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-cd06c7f2-11a9-41ab-bf67-727368c4abb6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/quotas/aa58a6fe20a449858977c517ca68518b HTTP/1.1" status: 200 len: 375 time: 0.0113199 Nov 08 04:15:23.541930 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-2ed9f29d-5e3b-4eb5-973a-539fd8c25cb5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0601797 Nov 08 04:15:23.649122 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-2bce8f66-be23-4bcb-8553-bf4243fd2a0d service neutron] 10.222.0.21 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0943081 Nov 08 04:15:23.737105 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-69286ff9-28ab-421a-82f1-42d20cb6425e service neutron] 10.222.0.21 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819986 Nov 08 04:15:23.877002 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb1c7f01-fa61-4468-a4d3-1453c8843adb req-222fae99-a81e-4fa2-af6b-333deed69e69 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:23.878645 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fb1c7f01-fa61-4468-a4d3-1453c8843adb req-222fae99-a81e-4fa2-af6b-333deed69e69 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 943 time: 0.0641472 Nov 08 04:15:23.931275 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fb1c7f01-fa61-4468-a4d3-1453c8843adb req-0f5553a5-ef97-447c-8f14-1aa354d2623d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458791 Nov 08 04:15:24.204608 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.248788 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55324) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:24.308151 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device e6483e56-c377-4575-bd34-b26a5c2bf382 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:15:24.322876 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 4bc6cc8c-782d-4718-85b4-81156f4a2000 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:15:24.347834 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1725591233-network', 'tenant_id': 'd23a714c188845279fa19f9c87df4def'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:15:24.359283 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: 4bc6cc8c-782d-4718-85b4-81156f4a2000 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:15:24.360116 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 4bc6cc8c-782d-4718-85b4-81156f4a2000 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:15:24.391008 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5009e121-55af-4c11-bf9f-954bb16cb230 req-4974eaa3-c598-44fc-9e55-c27480a5439e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 210 time: 0.0346603 Nov 08 04:15:24.445599 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:24.456993 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'port_id': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'mac_address': 'fa:16:3e:b2:b0:ef', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 184, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:15:24.484909 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Made reservation on behalf of d23a714c188845279fa19f9c87df4def for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:15:24.488869 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.496498 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55338) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:24.497302 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.507227 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.520105 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e6483e56-c377-4575-bd34-b26a5c2bf382 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:15:24.540543 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:24.574509 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.639069 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.667637 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.689438 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] vlan segment allocate from pool success with {'vlan_id': 150, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:15:24.695332 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=9']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:24.705242 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=125bb1c5-4045-423e-afc6-df481c0f781b,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:24.708326 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.708675 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Added segment 86bea8b1-4216-4683-8a95-512bc8c9bcac of type vlan for network 92ef9e7b-7c26-4986-b683-d2777b2485f6 Nov 08 04:15:24.747718 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.838782 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.839676 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:24.840257 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.904603 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] Pushing event updated for resources: {'Network': ['ID=92ef9e7b-7c26-4986-b683-d2777b2485f6,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:24.914929 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 92ef9e7b-7c26-4986-b683-d2777b2485f6 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:15:24.920645 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-703381'] for router_interface, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:24.951210 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-300ae01c-d32c-48ba-8cf4-c0d26f6db200 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6986742 Nov 08 04:15:24.951410 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55340) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:24.956467 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Request body: {'subnet': {'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1725591233-subnet', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'ip_version': 4}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:15:24.964412 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['e6483e56-c377-4575-bd34-b26a5c2bf382'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:15:25.069103 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Made reservation on behalf of d23a714c188845279fa19f9c87df4def for: {'subnet': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:15:25.071421 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4372208'] for subnet, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:25.082240 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6d36171-70b6-4c4d-8d1e-1af270452c49 req-98d67fe5-7db2-4afe-8dfe-01988da67e92 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:25.083353 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a6d36171-70b6-4c4d-8d1e-1af270452c49 req-98d67fe5-7db2-4afe-8dfe-01988da67e92 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 944 time: 0.0670834 Nov 08 04:15:25.197709 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a6d36171-70b6-4c4d-8d1e-1af270452c49 req-50422d3f-f1ee-4b9b-816f-d7e9401eab0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1048229 Nov 08 04:15:25.312267 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] Deleting port 551b7e72-649c-47e4-b44e-23c03034da1e {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:15:25.312606 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:25.391983 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] For port 551b7e72-649c-47e4-b44e-23c03034da1e, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=551b7e72-649c-47e4-b44e-23c03034da1e,segment=NetworkSegment(8f7e22fd-7d1a-479e-9785-43712201ed49),segment_id=8f7e22fd-7d1a-479e-9785-43712201ed49)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:25.392230 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6273101', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4372234'] for subnet, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:25.392419 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:25.405776 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] Calling delete_port for 551b7e72-649c-47e4-b44e-23c03034da1e owned by network:router_interface {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:15:25.485083 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Pushing event updated for resources: {'Subnet': ['ID=80d1402e-d73c-4668-9cb6-646683e6398f,revision_number=0']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:25.495010 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-603e4576-debc-410b-af5b-9068d57a0e42 req-19291c29-5f2a-4515-a1dc-05a1f31454c2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 210 time: 0.0452673 Nov 08 04:15:25.498787 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Checking segment: {'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:15:25.499410 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Network hostable DHCP agents. Network: 92ef9e7b-7c26-4986-b683-d2777b2485f6, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101665) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:15:25.638933 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Network 92ef9e7b-7c26-4986-b683-d2777b2485f6 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101665) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:15:25.696234 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:25.725842 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] Pushing event deleted for resources: {'Port': ['ID=551b7e72-649c-47e4-b44e-23c03034da1e,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:25.775756 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 92ef9e7b-7c26-4986-b683-d2777b2485f6) {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:25.780031 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:25.780663 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:25.784903 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7bd9652a-eeea-4b11-a6af-440966f33e90 None None] Network 92ef9e7b-7c26-4986-b683-d2777b2485f6 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:15:25.877166 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-3ed2986e-2eb4-4b1e-937c-4cd006c22948 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.9246266 Nov 08 04:15:25.882037 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55358) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:25.888760 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:15:25.902069 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530978', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-703013'] for router_interface, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.043063 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1dc029a-907a-45f5-8d40-22a521083537 req-ac1c12f0-af86-4c1f-afc3-0dae1643ff53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:26.044564 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1dc029a-907a-45f5-8d40-22a521083537 req-ac1c12f0-af86-4c1f-afc3-0dae1643ff53 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 1097 time: 0.0473695 Nov 08 04:15:26.066418 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-701463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7538'] for router, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.067689 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-701603', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-688686', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-770197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7531'] for router, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.068735 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp69aa137b-4136-5a6b-bf5e-deeb8c067c65-92ef9e7b-7c26-4986-b683-d2777b2485f6', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f'}]}} from dv-cinder-783643-4-iscsi. {{(pid=101666) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 04:15:26.072877 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.169532 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.211389 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] Router cb8d019a-2021-4fe7-8fb4-9a6a6883591c has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:15:26.224803 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.db_base_plugin_common [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Allocated IP 172.20.0.2 (92ef9e7b-7c26-4986-b683-d2777b2485f6/80d1402e-d73c-4668-9cb6-646683e6398f/06bebe1b-7cac-4835-a79d-70f62c97c067) {{(pid=101666) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:15:26.247351 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1dc029a-907a-45f5-8d40-22a521083537 req-c077cf52-0b20-446b-9906-b7caa0bcf103 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:26.252185 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1dc029a-907a-45f5-8d40-22a521083537 req-c077cf52-0b20-446b-9906-b7caa0bcf103 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 918 time: 0.1846969 Nov 08 04:15:26.384211 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1dc029a-907a-45f5-8d40-22a521083537 req-db8d1fb3-01e9-4121-a882-71fc6c1aa7c9 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=e6483e56-c377-4575-bd34-b26a5c2bf382 HTTP/1.1" status: 200 len: 999 time: 0.1240370 Nov 08 04:15:26.400748 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78c70b25-6785-4624-8fbd-532446f0cbad req-cfac55c9-c330-43bf-97f8-81a0f470bcb7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:26.402274 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-78c70b25-6785-4624-8fbd-532446f0cbad req-cfac55c9-c330-43bf-97f8-81a0f470bcb7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 944 time: 0.0809896 Nov 08 04:15:26.426015 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Publish callbacks [] for port, precommit_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.430829 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device e6483e56-c377-4575-bd34-b26a5c2bf382 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:26.477192 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1dc029a-907a-45f5-8d40-22a521083537 req-541124fd-c757-4e62-b6ae-969afb00c2e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:26.479502 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1dc029a-907a-45f5-8d40-22a521083537 req-541124fd-c757-4e62-b6ae-969afb00c2e6 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.0761139 Nov 08 04:15:26.482026 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port e6483e56-c377-4575-bd34-b26a5c2bf382 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:26.482400 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.503153 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-78c70b25-6785-4624-8fbd-532446f0cbad req-5db76c31-25bb-4564-b3ad-26f2f62c88d0 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0914700 Nov 08 04:15:26.508598 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.541511 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1dc029a-907a-45f5-8d40-22a521083537 req-20358096-b123-40be-a01d-ad7c0c9132f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:26.541511 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1dc029a-907a-45f5-8d40-22a521083537 req-20358096-b123-40be-a01d-ad7c0c9132f3 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0514896 Nov 08 04:15:26.559145 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Network 92ef9e7b-7c26-4986-b683-d2777b2485f6 is already hosted by enough agents. {{(pid=101666) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:26.564280 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.base_scheduler [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Resources bound (agent type, host, resource id): {{(pid=101666) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:26.571224 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Received port after_create {{(pid=101666) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:15:26.611229 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Pushing event updated for resources: {'Port': ['ID=06bebe1b-7cac-4835-a79d-70f62c97c067,revision_number=1']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:26.661551 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f85ce59-08d2-4984-b08f-e56fd470aa88 req-8e291e20-8412-45e8-8736-1bbba22371f7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 210 time: 0.0636392 Nov 08 04:15:26.671484 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Attempting to bind port 06bebe1b-7cac-4835-a79d-70f62c97c067 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:15:26.671806 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Attempting to bind port 06bebe1b-7cac-4835-a79d-70f62c97c067 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:15:26.672163 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Attempting to bind port 06bebe1b-7cac-4835-a79d-70f62c97c067 on network 92ef9e7b-7c26-4986-b683-d2777b2485f6 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:15:26.685456 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.689425 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 15, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:15:26.690401 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Checking segment: {'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:15:26.690871 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.691235 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Bound using segment: {'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:15:26.691720 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Bound port: 06bebe1b-7cac-4835-a79d-70f62c97c067, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:15:26.692104 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.693046 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1dc029a-907a-45f5-8d40-22a521083537 req-d6379c64-d986-46ae-9eb8-6dde99eac420 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1424675 Nov 08 04:15:26.711682 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.720963 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:15:26.732696 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-7396670f-7f04-4a5c-98bf-c087b9b537e6 admin admin] 10.222.0.21 "PUT /v2.0/routers/cb8d019a-2021-4fe7-8fb4-9a6a6883591c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2291453 Nov 08 04:15:26.732789 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] Sync routers for ids ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:15:26.737756 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:15:26.738339 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55368) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:26.740252 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-934813af-c06e-4022-bf73-f8b1ef9a6f05" -d '{"events": [{"server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "name": "network-vif-plugged", "status": "completed", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:15:26.748778 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] Routers {'cb8d019a-2021-4fe7-8fb4-9a6a6883591c'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:26.749692 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:26.774158 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:26.832186 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] For port 06bebe1b-7cac-4835-a79d-70f62c97c067, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:15:26.836403 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:15:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c3abf56-a03a-4808-9323-596831619e63 x-openstack-request-id: req-8c3abf56-a03a-4808-9323-596831619e63 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:15:26.836722 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "name": "network-vif-plugged", "status": "completed", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:15:26.837290 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-8c3abf56-a03a-4808-9323-596831619e63 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:15:26.839553 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'code': 200} Nov 08 04:15:26.841433 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] For port 06bebe1b-7cac-4835-a79d-70f62c97c067, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=06bebe1b-7cac-4835-a79d-70f62c97c067,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:15:26.844994 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1dc029a-907a-45f5-8d40-22a521083537 req-758a3ff7-e282-4b20-b565-f83af63f1999 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1199403 Nov 08 04:15:26.883178 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.887456 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Publish callbacks [] for router, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.903145 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] Set router cb8d019a-2021-4fe7-8fb4-9a6a6883591c gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:26.922314 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:26.946430 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=10']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:27.007972 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f651b58-af4b-4d59-9b5b-bd921663c514 None None] Pushing event updated for resources: {'Port': ['ID=06bebe1b-7cac-4835-a79d-70f62c97c067,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:27.115051 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:27.206773 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-router', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8'}], 'enable_snat': True}, 'gw_port_id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:15:25Z', 'revision_number': 5, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'gw_port': {'id': '83053c09-bb46-4b81-bc81-131ecfb62855', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:8a:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.8', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:20Z', 'updated_at': '2021-11-08T04:11:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:27.209388 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-e15dc43b-1e6f-4c8e-9972-255fbeb8b52f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:27.210937 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-e15dc43b-1e6f-4c8e-9972-255fbeb8b52f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 812 time: 0.1916871 Nov 08 04:15:27.227292 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:27.284857 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] Checking router: cb8d019a-2021-4fe7-8fb4-9a6a6883591c for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:15:27.296408 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:27.299323 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] Routers {'cb8d019a-2021-4fe7-8fb4-9a6a6883591c'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:27.300500 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:27.366950 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-e9a08cdf-4f31-46d9-bd72-7ad920d86a05 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aa58a6fe20a449858977c517ca68518b HTTP/1.1" status: 200 len: 380 time: 0.1394751 Nov 08 04:15:27.382837 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'port': {'device_id': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'admin_state_up': True, 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'security_groups': ['b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb']}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:15:27.428428 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Deleting port 83053c09-bb46-4b81-bc81-131ecfb62855 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:15:27.428721 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:27.513727 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] Set router cb8d019a-2021-4fe7-8fb4-9a6a6883591c gateway port host: None {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:27.578324 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-router', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:15:27Z', 'revision_number': 6, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'gw_port_host': None}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:27.610427 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af802be9-1b02-4c82-b45d-fb77d12d9fe8 None None] The sync data for ids ['cb8d019a-2021-4fe7-8fb4-9a6a6883591c'] in dv-cinder-783643-4-iscsi is: [{'id': 'cb8d019a-2021-4fe7-8fb4-9a6a6883591c', 'name': 'tempest-ServerRescueNegativeTestJSON-1518707026-router', 'tenant_id': 'e9678ed98e7944babc4f6af7fb368440', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:15:27Z', 'revision_number': 6, 'project_id': 'e9678ed98e7944babc4f6af7fb368440', 'gw_port_host': None}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:15:27.616268 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Made reservation on behalf of aa58a6fe20a449858977c517ca68518b for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:15:27.619659 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] For port 83053c09-bb46-4b81-bc81-131ecfb62855, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=83053c09-bb46-4b81-bc81-131ecfb62855,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:27.620072 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:27.620313 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:27.623130 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Allocated IP 172.27.2.172 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/b4251616-5532-4f50-a022-45771944479c) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:15:27.641447 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Calling delete_port for 83053c09-bb46-4b81-bc81-131ecfb62855 owned by network:router_gateway {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:15:27.656468 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-654a5543-1366-4881-85c7-0cf9380901fa req-e57245ba-1610-4cee-80eb-fa539242afcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:27.657981 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-654a5543-1366-4881-85c7-0cf9380901fa req-e57245ba-1610-4cee-80eb-fa539242afcf service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 1099 time: 0.1178946 Nov 08 04:15:27.800181 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7b0178c6-3102-4847-a0d9-700fb9bbe935 req-edbd7d44-b429-4115-b1ef-b16a040fb522 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 210 time: 0.0327237 Nov 08 04:15:27.812587 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80267199-5db3-4994-b19e-b58aaf51e6b1 req-00f8e360-8f0d-4b09-98ec-292d28b36de6 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:27.814043 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80267199-5db3-4994-b19e-b58aaf51e6b1 req-00f8e360-8f0d-4b09-98ec-292d28b36de6 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 946 time: 0.1746445 Nov 08 04:15:27.820383 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-654a5543-1366-4881-85c7-0cf9380901fa req-486e908f-cf60-406e-b20c-34b7e5186578 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1492906 Nov 08 04:15:27.886676 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:27.888934 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Allocated IP 172.20.0.13 (16cbde97-55ea-47f6-bd55-cf46e7c41a49/5926063e-8f31-4623-9cfc-4a0b577bdb41/8bfbc5de-2401-404d-81e1-3e4465bb44c8) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:15:27.931241 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80267199-5db3-4994-b19e-b58aaf51e6b1 req-d4288746-2fac-4e61-bacf-9087a3b6502c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0955107 Nov 08 04:15:28.059707 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.072002 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.115382 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:28.121402 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:28.124118 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:15:28.195554 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Pushing event updated for resources: {'Port': ['ID=b4251616-5532-4f50-a022-45771944479c,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:28.210036 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.230413 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Pushing event deleted for resources: {'Port': ['ID=83053c09-bb46-4b81-bc81-131ecfb62855,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:28.249972 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-688863'] for router_gateway, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.260882 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f52b902f-60a3-40b3-804d-9e752625256d None None] Network 92ef9e7b-7c26-4986-b683-d2777b2485f6 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:15:28.335964 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-9a70a262-4d6f-4187-af0b-901c8ae056be None None] Provisioning complete for port 06bebe1b-7cac-4835-a79d-70f62c97c067 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:28.336278 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9a70a262-4d6f-4187-af0b-901c8ae056be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.342790 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.400833 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:28.406186 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:28.413663 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:15:28.421676 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'Port': ['ID=8bfbc5de-2401-404d-81e1-3e4465bb44c8,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:28.452077 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-700541', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7524'] for router, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.456320 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.492219 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:28.493132 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.509069 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9a70a262-4d6f-4187-af0b-901c8ae056be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.549729 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-9a70a262-4d6f-4187-af0b-901c8ae056be None None] For port 06bebe1b-7cac-4835-a79d-70f62c97c067, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=06bebe1b-7cac-4835-a79d-70f62c97c067,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:28.596465 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-ff52ea07-2953-46ac-875a-8780cf40a0ac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2175190 Nov 08 04:15:28.618132 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Request body: {'port': {'device_id': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:15:28.633736 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9a70a262-4d6f-4187-af0b-901c8ae056be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.637341 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-700518'] for router, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.637341 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Fanout notify agent at l3_agent the message router_deleted on router cb8d019a-2021-4fe7-8fb4-9a6a6883591c {{(pid=101664) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 04:15:28.641935 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.643848 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-876f0a13-0b28-43a7-bbd6-ceaad0a2238c admin admin] 10.222.0.21 "DELETE /v2.0/routers/cb8d019a-2021-4fe7-8fb4-9a6a6883591c HTTP/1.1" status: 204 len: 168 time: 1.9037962 Nov 08 04:15:28.647714 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55386) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:28.712067 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.738083 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a70a262-4d6f-4187-af0b-901c8ae056be None None] Pushing event updated for resources: {'Port': ['ID=06bebe1b-7cac-4835-a79d-70f62c97c067,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:28.782162 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_v2 [None req-a81b5e64-2f2f-4eda-87bc-154010a20301 admin admin] Deleting subnet 900a12a5-1baa-47e1-8b64-245dc70bc9f2 {{(pid=101664) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:15:28.789938 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a81b5e64-2f2f-4eda-87bc-154010a20301 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.879285 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a81b5e64-2f2f-4eda-87bc-154010a20301 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6285890'] for subnet, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.941354 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:28.986616 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-f2587450-5d3a-486c-9ffb-648744d9e3dc None None] Provisioning complete for port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:28.987771 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f2587450-5d3a-486c-9ffb-648744d9e3dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.014004 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a81b5e64-2f2f-4eda-87bc-154010a20301 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.038617 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77434151-e25b-40c4-bcc1-c2f40cd48838 req-12815bfc-c425-4e18-87be-c151db4b3138 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:29.040162 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-77434151-e25b-40c4-bcc1-c2f40cd48838 req-12815bfc-c425-4e18-87be-c151db4b3138 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 932 time: 0.1112499 Nov 08 04:15:29.069027 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-f2587450-5d3a-486c-9ffb-648744d9e3dc None None] Port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:15:29.186820 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-77434151-e25b-40c4-bcc1-c2f40cd48838 req-3cb22df6-d975-4e3f-a424-5ca40d95545e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1384835 Nov 08 04:15:29.227249 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d553b0b-4dc7-4301-a406-70777dca6578 req-0a7614e5-77d2-4b94-b82c-5420b1a7f900 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:29.229050 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0d553b0b-4dc7-4301-a406-70777dca6578 req-0a7614e5-77d2-4b94-b82c-5420b1a7f900 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 946 time: 0.1471472 Nov 08 04:15:29.236030 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-36ab7c1c-ae53-4b42-883b-3672d58abf32 None None] Provisioning complete for port 06bebe1b-7cac-4835-a79d-70f62c97c067 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:29.244467 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-36ab7c1c-ae53-4b42-883b-3672d58abf32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.291547 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 06bebe1b-7cac-4835-a79d-70f62c97c067 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:29.322353 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8bfbc5de-2401-404d-81e1-3e4465bb44c8 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:15:29.337144 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.363604 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Transition to ACTIVE for port object 8bfbc5de-2401-404d-81e1-3e4465bb44c8 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:15:29.380180 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0d553b0b-4dc7-4301-a406-70777dca6578 req-270e5deb-a378-410f-959a-3d0069e0b8ee tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1055720 Nov 08 04:15:29.400368 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 06bebe1b-7cac-4835-a79d-70f62c97c067 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:29.400782 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.491278 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.562870 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Pushing event updated for resources: {'Port': ['ID=8bfbc5de-2401-404d-81e1-3e4465bb44c8,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:29.568992 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 551b7e72-649c-47e4-b44e-23c03034da1e no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:15:29.576116 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a81b5e64-2f2f-4eda-87bc-154010a20301 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5121021', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5043596'] for subnet, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.595449 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 551b7e72-649c-47e4-b44e-23c03034da1e {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:15:29.596022 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 551b7e72-649c-47e4-b44e-23c03034da1e not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:15:29.597869 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 83053c09-bb46-4b81-bc81-131ecfb62855 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:15:29.632120 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 83053c09-bb46-4b81-bc81-131ecfb62855 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:15:29.632466 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 83053c09-bb46-4b81-bc81-131ecfb62855 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:15:29.648489 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a81b5e64-2f2f-4eda-87bc-154010a20301 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=900a12a5-1baa-47e1-8b64-245dc70bc9f2,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:29.654061 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a81b5e64-2f2f-4eda-87bc-154010a20301 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.660224 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a81b5e64-2f2f-4eda-87bc-154010a20301 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/900a12a5-1baa-47e1-8b64-245dc70bc9f2 HTTP/1.1" status: 204 len: 168 time: 1.0109074 Nov 08 04:15:29.662971 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55412) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:29.687709 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-701612', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891'] for router, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.798961 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.883067 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Attempting to bind port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:15:29.883408 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Attempting to bind port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:15:29.883742 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Attempting to bind port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:15:29.889104 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:15:29.889440 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Attempting to bind port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:15:29.895423 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 15, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:15:29.895669 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Checking segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:15:29.896263 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Bound using segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:15:29.896699 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Bound port: 8bfbc5de-2401-404d-81e1-3e4465bb44c8, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:15:29.897052 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.932127 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.959389 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] For port 8bfbc5de-2401-404d-81e1-3e4465bb44c8, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:15:29.960780 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8']}} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:29.962380 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] For port 8bfbc5de-2401-404d-81e1-3e4465bb44c8, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=8bfbc5de-2401-404d-81e1-3e4465bb44c8,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:15:29.971762 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8f7e22fd-7d1a-479e-9785-43712201ed49') {'for_net_delete': True} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:29.972053 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8f7e22fd-7d1a-479e-9785-43712201ed49') {} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:29.981781 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6285915'] for segment, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:29.995514 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:30.001884 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] Releasing vlan 170 on physical network physnet1 to pool {{(pid=101664) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:15:30.002266 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5120795'] for segment, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: Traceback (most recent call last): Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: timer() Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: cb(*args, **kw) Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: return func(*args, **kwargs) Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: self._notify() Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: self.callback(batched_events) Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: event.method(event) Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: return f(self, *a, **k) Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._get(url).json() Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: return self.request(url, 'GET', **kwargs) Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:15:30.004533 dv-cinder-783643-4-iscsi neutron-server[101664]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:15:30.061630 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Router b957ebf8-7cce-4f10-a834-1069f67f87ec is scheduled to L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 with binding_index 1 {{(pid=101664) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 04:15:30.062097 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:30.097547 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:30.098153 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:30.099682 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] 10.222.0.16 "PUT /v2.0/ports/8bfbc5de-2401-404d-81e1-3e4465bb44c8 HTTP/1.1" status: 200 len: 1094 time: 1.4858646 Nov 08 04:15:30.100134 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'tag': '8bfbc5de-2401-404d-81e1-3e4465bb44c8'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:15:30.102392 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a971f738-6092-472a-94cc-02b006a11814" -d '{"events": [{"name": "network-changed", "server_uuid": "e1b4ed4d-2888-42c9-bb24-200f03c9efe0", "tag": "8bfbc5de-2401-404d-81e1-3e4465bb44c8"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:15:30.140648 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d77d651-d272-4963-ba13-14f505c0a0ea service neutron] Pushing event updated for resources: {'Port': ['ID=8bfbc5de-2401-404d-81e1-3e4465bb44c8,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:30.141968 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:30.156510 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:15:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d7969222-7280-41b2-85be-2978ba9b8d1e x-openstack-request-id: req-d7969222-7280-41b2-85be-2978ba9b8d1e {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:15:30.156801 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e1b4ed4d-2888-42c9-bb24-200f03c9efe0", "tag": "8bfbc5de-2401-404d-81e1-3e4465bb44c8", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:15:30.157048 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-d7969222-7280-41b2-85be-2978ba9b8d1e {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:15:30.158220 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'tag': '8bfbc5de-2401-404d-81e1-3e4465bb44c8', 'status': 'completed', 'code': 200} Nov 08 04:15:30.181560 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:30.187538 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] 10.222.0.21 "DELETE /v2.0/networks/8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8 HTTP/1.1" status: 204 len: 168 time: 0.5209267 Nov 08 04:15:30.205319 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5e34346-22fd-4092-8beb-b0629b75c0be admin admin] Pushing event deleted for resources: {'Network': ['ID=8c5ec902-720d-46cc-ba1d-cfb4c8dbf6b8,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:30.235019 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:15:30.250612 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Sync routers for ids ['b957ebf8-7cce-4f10-a834-1069f67f87ec'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:15:30.271773 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a971f738-6092-472a-94cc-02b006a11814 req-b19dbd3e-aa6b-41ed-a550-15c0622f9815 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:30.279374 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a971f738-6092-472a-94cc-02b006a11814 req-b19dbd3e-aa6b-41ed-a550-15c0622f9815 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 1097 time: 0.0647397 Nov 08 04:15:30.288407 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Routers {'b957ebf8-7cce-4f10-a834-1069f67f87ec'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:30.289122 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b957ebf8-7cce-4f10-a834-1069f67f87ec'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:30.350061 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:30.351454 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-9c0bdfbc-0cfd-490f-ab59-ac478594d08e admin admin] 10.222.0.21 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 4.4684403 Nov 08 04:15:30.355887 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55442) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:30.415223 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Set router b957ebf8-7cce-4f10-a834-1069f67f87ec gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:30.444529 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b417deb-9208-435e-8983-181130bcc656 req-e40eac5c-51fb-4b60-ba86-3dd3b703d47b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:30.446159 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b417deb-9208-435e-8983-181130bcc656 req-e40eac5c-51fb-4b60-ba86-3dd3b703d47b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 944 time: 0.1284659 Nov 08 04:15:30.556647 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b417deb-9208-435e-8983-181130bcc656 req-ee636175-b919-404c-9783-bb223a2f9bb0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0950456 Nov 08 04:15:30.573405 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a971f738-6092-472a-94cc-02b006a11814 req-43747d2b-b1ca-4c90-921d-8bb71a0447a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:30.574987 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a971f738-6092-472a-94cc-02b006a11814 req-43747d2b-b1ca-4c90-921d-8bb71a0447a1 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=aa58a6fe20a449858977c517ca68518b&shared=False HTTP/1.1" status: 200 len: 913 time: 0.2848513 Nov 08 04:15:30.640618 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:28Z', 'revision_number': 3, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:30.687497 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Checking router: b957ebf8-7cce-4f10-a834-1069f67f87ec for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:15:30.688255 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Updating router b957ebf8-7cce-4f10-a834-1069f67f87ec port b4251616-5532-4f50-a022-45771944479c binding host dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:15:30.711056 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e16c347f-4c23-429e-8c95-426d217fe563 req-8abe5fe1-aa43-4876-89ca-c936e00c12ad tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:30.714509 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e16c347f-4c23-429e-8c95-426d217fe563 req-8abe5fe1-aa43-4876-89ca-c936e00c12ad tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 946 time: 0.1852083 Nov 08 04:15:30.734910 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:30.737304 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55450) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:30.819298 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-40569b89-31f8-4d56-ad0a-6fc5afd407b9 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=e9678ed98e7944babc4f6af7fb368440&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0789824 Nov 08 04:15:30.823403 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a971f738-6092-472a-94cc-02b006a11814 req-8d5a2a32-e273-4e04-ae46-9a3e42bb43bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:30.825438 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a971f738-6092-472a-94cc-02b006a11814 req-8d5a2a32-e273-4e04-ae46-9a3e42bb43bc service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2184527 Nov 08 04:15:30.825586 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55452) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:30.847122 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e16c347f-4c23-429e-8c95-426d217fe563 req-30c9db0b-f973-425f-a06a-54a9799e1c46 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1209962 Nov 08 04:15:30.933619 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-4be20759-49a1-4246-9123-8e117b1a648d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:30.935516 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-4be20759-49a1-4246-9123-8e117b1a648d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 1097 time: 0.0436862 Nov 08 04:15:30.947933 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-40505e27-f0f0-4d92-a61d-273e17ea825f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:30.980049 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-40505e27-f0f0-4d92-a61d-273e17ea825f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:30.999153 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-b0055a2c-8342-4728-b958-a49971a56907 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=8bfbc5de-2401-404d-81e1-3e4465bb44c8 HTTP/1.1" status: 200 len: 217 time: 0.0480475 Nov 08 04:15:31.043717 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.067162 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-2d73acdc-aed4-44aa-976f-9c003461dfaa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:31.069363 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-2d73acdc-aed4-44aa-976f-9c003461dfaa service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0634921 Nov 08 04:15:31.093275 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Publish callbacks [] for port, precommit_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.119313 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-48bd1fb9-236d-4f3d-8d90-4d00aaa1bb9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:31.120806 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-48bd1fb9-236d-4f3d-8d90-4d00aaa1bb9a service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0423405 Nov 08 04:15:31.197576 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.203226 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-40505e27-f0f0-4d92-a61d-273e17ea825f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.205767 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-40505e27-f0f0-4d92-a61d-273e17ea825f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.206915 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-40505e27-f0f0-4d92-a61d-273e17ea825f admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/62a05974-7d67-4e01-81d5-ecfb972cef00 HTTP/1.1" status: 204 len: 168 time: 0.3806336 Nov 08 04:15:31.218999 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40505e27-f0f0-4d92-a61d-273e17ea825f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62a05974-7d67-4e01-81d5-ecfb972cef00,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:31.231462 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-7943c2ff-014f-44cb-a754-32bdd894cb5d service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1028135 Nov 08 04:15:31.244106 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Allocated IP 172.20.0.1 (92ef9e7b-7c26-4986-b683-d2777b2485f6/80d1402e-d73c-4668-9cb6-646683e6398f/f8d2bcad-96e3-44ea-b4e9-0ae6561bb929) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:15:31.291342 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3943e07b-ae01-4c49-a00c-2306cf578963 None None] Pushing event updated for resources: {'Port': ['ID=b4251616-5532-4f50-a022-45771944479c,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:31.300439 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Attempting to bind port b4251616-5532-4f50-a022-45771944479c on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:15:31.300819 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Attempting to bind port b4251616-5532-4f50-a022-45771944479c by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:15:31.301181 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Attempting to bind port b4251616-5532-4f50-a022-45771944479c on network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:15:31.306958 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 15, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:15:31.310814 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:15:31.310814 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.310814 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Bound using segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:15:31.310814 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Bound port: b4251616-5532-4f50-a022-45771944479c, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:15:31.310814 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.368694 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] For port b4251616-5532-4f50-a022-45771944479c, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:15:31.373071 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0eefd904-d09b-46bd-b7e8-9d47fde7ec7e req-65821d79-e4af-4733-bb8d-aadb7bd47f3c service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1330552 Nov 08 04:15:31.373304 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] For port b4251616-5532-4f50-a022-45771944479c, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=b4251616-5532-4f50-a022-45771944479c,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:15:31.381133 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.450979 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.496467 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.510630 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Routers {'b957ebf8-7cce-4f10-a834-1069f67f87ec'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:31.511247 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b957ebf8-7cce-4f10-a834-1069f67f87ec'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:31.538058 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Network 92ef9e7b-7c26-4986-b683-d2777b2485f6 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:31.542389 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:31.545834 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:15:31.551762 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3943e07b-ae01-4c49-a00c-2306cf578963 None None] Pushing event updated for resources: {'Port': ['ID=b4251616-5532-4f50-a022-45771944479c,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:31.590392 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Pushing event updated for resources: {'Port': ['ID=f8d2bcad-96e3-44ea-b4e9-0ae6561bb929,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:31.611016 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-703278'] for router_interface, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.661771 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] Set router b957ebf8-7cce-4f10-a834-1069f67f87ec gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:31.767701 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f24ab24d-61e7-42c4-8add-2c52c26ff152 req-afb0e805-66bb-4d9b-8c9f-679427b8622a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:31.769292 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f24ab24d-61e7-42c4-8add-2c52c26ff152 req-afb0e805-66bb-4d9b-8c9f-679427b8622a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 944 time: 0.1277680 Nov 08 04:15:31.848436 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f24ab24d-61e7-42c4-8add-2c52c26ff152 req-c836492d-fd2d-40ab-af62-8c6e3440db60 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0717421 Nov 08 04:15:31.906576 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:31.997841 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f92ff4d-1c36-480f-b139-46df39d142da req-d92e00fd-279c-423c-a5ce-47b68d6c5f0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:31.999419 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2f92ff4d-1c36-480f-b139-46df39d142da req-d92e00fd-279c-423c-a5ce-47b68d6c5f0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 946 time: 0.0567617 Nov 08 04:15:32.015556 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-2230e2d3-20c0-4102-8173-8542c3de3fcf None None] Provisioning complete for port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:32.016021 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-2230e2d3-20c0-4102-8173-8542c3de3fcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.055694 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2f92ff4d-1c36-480f-b139-46df39d142da req-d320c95a-886c-4812-95da-c869147ce5a2 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479193 Nov 08 04:15:32.057892 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-2230e2d3-20c0-4102-8173-8542c3de3fcf None None] Port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:15:32.090703 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:28Z', 'revision_number': 3, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:32.113988 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31b5c04b-e163-4491-9196-0098e64ec475 None None] The sync data for ids ['b957ebf8-7cce-4f10-a834-1069f67f87ec'] in dv-cinder-783643-4-iscsi is: [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:28Z', 'revision_number': 3, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:15:32.119441 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.181691 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.216140 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55480) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:32.258194 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Pushing event updated for resources: {'Port': ['ID=f8d2bcad-96e3-44ea-b4e9-0ae6561bb929,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:32.260779 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530987', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-703418'] for router_interface, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.340219 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-999e4e5a-3f8f-47aa-ae13-02f934f4066c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.357352 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Network 92ef9e7b-7c26-4986-b683-d2777b2485f6 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:32.359262 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:32.472342 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-999e4e5a-3f8f-47aa-ae13-02f934f4066c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.529201 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-999e4e5a-3f8f-47aa-ae13-02f934f4066c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.558170 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Router b957ebf8-7cce-4f10-a834-1069f67f87ec has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:15:32.576843 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-999e4e5a-3f8f-47aa-ae13-02f934f4066c admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=7b60973db47f48999296911dff919d74&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3593347 Nov 08 04:15:32.578708 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55490) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:32.641818 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-999e4e5a-3f8f-47aa-ae13-02f934f4066c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2117e429-a5a8-404b-a57c-d4299b219aac,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:32.657295 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b1aeaaf2-8979-4d05-8079-f335f77be33c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.688213 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-f777613e-5fee-4017-aa9d-c82c46a6de24 None None] Provisioning complete for port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:32.688776 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f777613e-5fee-4017-aa9d-c82c46a6de24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.700839 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:15:32.703747 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b1aeaaf2-8979-4d05-8079-f335f77be33c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.706702 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-2b3a7560-fd1c-4845-a755-3e92a6f8df63 admin admin] 10.222.0.21 "PUT /v2.0/routers/b957ebf8-7cce-4f10-a834-1069f67f87ec/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3491311 Nov 08 04:15:32.755442 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-f777613e-5fee-4017-aa9d-c82c46a6de24 None None] Port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:15:32.837737 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b1aeaaf2-8979-4d05-8079-f335f77be33c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.840631 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b1aeaaf2-8979-4d05-8079-f335f77be33c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:32.844639 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b1aeaaf2-8979-4d05-8079-f335f77be33c admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/2117e429-a5a8-404b-a57c-d4299b219aac HTTP/1.1" status: 204 len: 168 time: 0.2622132 Nov 08 04:15:32.851382 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1aeaaf2-8979-4d05-8079-f335f77be33c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2117e429-a5a8-404b-a57c-d4299b219aac,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:32.982721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0478e853-1cf3-4ce5-ba72-e1d462e847cc req-efced8fe-be25-4e09-90fc-dc50055be61b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:32.984405 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0478e853-1cf3-4ce5-ba72-e1d462e847cc req-efced8fe-be25-4e09-90fc-dc50055be61b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 944 time: 0.0587687 Nov 08 04:15:33.035653 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0478e853-1cf3-4ce5-ba72-e1d462e847cc req-1c35b714-9a94-4316-8494-ce5aa6c9045a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447204 Nov 08 04:15:33.161790 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device b4251616-5532-4f50-a022-45771944479c up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:33.218199 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port b4251616-5532-4f50-a022-45771944479c triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:33.218595 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:33.298448 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:33.319279 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port b4251616-5532-4f50-a022-45771944479c, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=b4251616-5532-4f50-a022-45771944479c,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:33.415894 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:33.461612 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=b4251616-5532-4f50-a022-45771944479c,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:33.726083 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55522) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:33.746440 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f39cd668-8ba5-4d0c-9646-3b0707a7d591 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:33.834714 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f39cd668-8ba5-4d0c-9646-3b0707a7d591 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:33.896175 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f39cd668-8ba5-4d0c-9646-3b0707a7d591 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:33.947575 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f39cd668-8ba5-4d0c-9646-3b0707a7d591 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2d19683-810b-4c38-9e4a-dc728a67de8a,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:33.948654 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Sync routers for ids ['b957ebf8-7cce-4f10-a834-1069f67f87ec'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:15:33.965159 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Routers {'b957ebf8-7cce-4f10-a834-1069f67f87ec'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:33.966116 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b957ebf8-7cce-4f10-a834-1069f67f87ec'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:33.967800 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55530) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:33.971616 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f39cd668-8ba5-4d0c-9646-3b0707a7d591 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=5819b28e73904ce4853cbbf597553b3a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2444105 Nov 08 04:15:34.028023 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c229748-25d6-403c-b786-b1fd9b48be4d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.058129 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c229748-25d6-403c-b786-b1fd9b48be4d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.097987 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Set router b957ebf8-7cce-4f10-a834-1069f67f87ec gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:34.105623 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55540) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:34.110633 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1631031505-network', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:15:34.164033 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b83de0b8-52ef-4256-8fad-60d9de01dc93 req-3efdb2bf-2a13-48df-83b5-567bd45d7a35 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:34.165641 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b83de0b8-52ef-4256-8fad-60d9de01dc93 req-3efdb2bf-2a13-48df-83b5-567bd45d7a35 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 944 time: 0.0549264 Nov 08 04:15:34.217386 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Made reservation on behalf of 5550d3215c604df0a8d8690af521cbb2 for: {'network': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:15:34.219798 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.229657 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.233806 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b83de0b8-52ef-4256-8fad-60d9de01dc93 req-59c5e3f6-7c39-4de3-b0d0-967ff1d997ba tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0597494 Nov 08 04:15:34.261652 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c229748-25d6-403c-b786-b1fd9b48be4d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.268712 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c229748-25d6-403c-b786-b1fd9b48be4d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.268712 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-7c229748-25d6-403c-b786-b1fd9b48be4d admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/f2d19683-810b-4c38-9e4a-dc728a67de8a HTTP/1.1" status: 204 len: 168 time: 0.2954085 Nov 08 04:15:34.280362 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c229748-25d6-403c-b786-b1fd9b48be4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2d19683-810b-4c38-9e4a-dc728a67de8a,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:34.325443 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.403535 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.422155 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f8d2bcad-96e3-44ea-b4e9-0ae6561bb929', 'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'mac_address': 'fa:16:3e:19:26:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:31Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 2, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'subnets': [{'id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:34.423819 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] vlan segment allocate from pool success with {'vlan_id': 177, 'physical_network': 'physnet1'} {{(pid=101664) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:15:34.441205 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.441552 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.segments_db [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Added segment 0b48935c-b047-416c-af65-64437316f0d9 of type vlan for network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd Nov 08 04:15:34.442897 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83c49cf5-ff43-473c-85d0-7f2b92def0e1,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:34.448140 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Checking router: b957ebf8-7cce-4f10-a834-1069f67f87ec for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:15:34.448505 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Updating router b957ebf8-7cce-4f10-a834-1069f67f87ec port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 binding host dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:15:34.473803 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.495511 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.650164 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.651210 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:34.651791 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.722399 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Pushing event updated for resources: {'Network': ['ID=473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:34.729538 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.729884 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.730217 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.730570 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.730902 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.731230 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.731553 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.731879 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.732206 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.732524 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.732846 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.733159 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.745697 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:15:34.748636 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-9c20ba46-db74-4983-8379-8ded21b6a6c5 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6419857 Nov 08 04:15:34.751392 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55554) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:34.756796 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Request body: {'subnet': {'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1631031505-subnet', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'ip_version': 4}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:15:34.788204 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Publish callbacks [] for port, precommit_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.855861 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Made reservation on behalf of 5550d3215c604df0a8d8690af521cbb2 for: {'subnet': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:15:34.859090 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4372208'] for subnet, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.871666 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:34.925995 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Pushing event updated for resources: {'Port': ['ID=f8d2bcad-96e3-44ea-b4e9-0ae6561bb929,revision_number=3']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:34.952991 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.953621 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.953707 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.954022 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.954353 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.954735 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.955065 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.955424 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.955766 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.956096 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.956418 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.956743 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:34.992460 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Attempting to bind port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:15:34.992827 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Attempting to bind port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:15:34.993190 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Attempting to bind port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 on network 92ef9e7b-7c26-4986-b683-d2777b2485f6 {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:15:34.999324 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 15, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:15:35.000335 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Checking segment: {'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101667) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:15:35.000335 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.000535 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Bound using segment: {'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:15:35.000901 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Bound port: f8d2bcad-96e3-44ea-b4e9-0ae6561bb929, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'}}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:15:35.001293 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.075432 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] For port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101667) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:15:35.078794 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] For port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=f8d2bcad-96e3-44ea-b4e9-0ae6561bb929,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101667) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:15:35.134637 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device b4251616-5532-4f50-a022-45771944479c up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:35.176599 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6273101', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4372234'] for subnet, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.189335 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port b4251616-5532-4f50-a022-45771944479c triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:35.189720 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.211403 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.216002 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-374c9092-9097-4a44-850d-99b68a3c3617 None None] Provisioning complete for port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:35.216363 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-374c9092-9097-4a44-850d-99b68a3c3617 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.274012 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Routers {'b957ebf8-7cce-4f10-a834-1069f67f87ec'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:35.275231 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b957ebf8-7cce-4f10-a834-1069f67f87ec'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:35.296192 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Pushing event updated for resources: {'Subnet': ['ID=abb984ac-8c1e-423f-8584-f542a644ade9,revision_number=0']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:35.315211 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Checking segment: {'id': '0b48935c-b047-416c-af65-64437316f0d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:15:35.315211 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Network hostable DHCP agents. Network: 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101665) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:15:35.409527 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] Set router b957ebf8-7cce-4f10-a834-1069f67f87ec gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:35.454635 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101665) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:15:35.464943 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-374c9092-9097-4a44-850d-99b68a3c3617 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.493046 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5893dd29-be0b-450c-843b-207f38159c1e req-a17ac906-ae88-4c14-a7ad-bfbe48485765 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:35.494175 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5893dd29-be0b-450c-843b-207f38159c1e req-a17ac906-ae88-4c14-a7ad-bfbe48485765 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 944 time: 0.1124632 Nov 08 04:15:35.526017 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-374c9092-9097-4a44-850d-99b68a3c3617 None None] For port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=f8d2bcad-96e3-44ea-b4e9-0ae6561bb929,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:35.560393 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5893dd29-be0b-450c-843b-207f38159c1e req-c44a783e-5206-4ad7-9c41-fbf0f4af58de tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0556448 Nov 08 04:15:35.561552 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd) {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:35.564574 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee5139b0-6047-4b00-8453-b08f5fe9e08d None None] Pushing event updated for resources: {'Port': ['ID=f8d2bcad-96e3-44ea-b4e9-0ae6561bb929,revision_number=4']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:35.568069 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:35.570416 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.574327 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae77d679-96a2-4236-9a0e-7b70b48bc06e None None] Network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:15:35.636257 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-374c9092-9097-4a44-850d-99b68a3c3617 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.661496 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f8d2bcad-96e3-44ea-b4e9-0ae6561bb929', 'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'mac_address': 'fa:16:3e:19:26:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:31Z', 'updated_at': '2021-11-08T04:15:35Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'subnets': [{'id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:35.692432 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-612d6125-bc67-4065-bc4a-61b379ce8cca None None] The sync data for ids ['b957ebf8-7cce-4f10-a834-1069f67f87ec'] in dv-cinder-783643-4-iscsi is: [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f8d2bcad-96e3-44ea-b4e9-0ae6561bb929', 'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'mac_address': 'fa:16:3e:19:26:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:31Z', 'updated_at': '2021-11-08T04:15:35Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'subnets': [{'id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:15:35.702559 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-da996a61-8775-44ce-a235-53c5b3f27067 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.9500093 Nov 08 04:15:35.708256 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55578) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:35.710532 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-374c9092-9097-4a44-850d-99b68a3c3617 None None] Pushing event updated for resources: {'Port': ['ID=f8d2bcad-96e3-44ea-b4e9-0ae6561bb929,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:35.712621 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1631031505-router', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:15:35.805293 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-f361dd4a-f4fb-4d64-8207-127051454798 None None] Provisioning complete for port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:35.805810 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f361dd4a-f4fb-4d64-8207-127051454798 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.829905 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp69aa137b-4136-5a6b-bf5e-deeb8c067c65-473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd', 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'fixed_ips': [{'subnet_id': 'abb984ac-8c1e-423f-8584-f542a644ade9'}]}} from dv-cinder-783643-4-iscsi. {{(pid=101666) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 04:15:35.831287 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.838891 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-701463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7538'] for router, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.839948 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-701603', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-688686', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-770197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7531'] for router, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:35.912604 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.022704 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.db_base_plugin_common [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Allocated IP 172.20.0.2 (473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd/abb984ac-8c1e-423f-8584-f542a644ade9/0fc5f8ba-8da4-429f-903e-274bd4316a60) {{(pid=101666) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:15:36.141146 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.187659 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Publish callbacks [] for port, precommit_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.307751 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.348104 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd is already hosted by enough agents. {{(pid=101666) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:36.352983 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.base_scheduler [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Resources bound (agent type, host, resource id): {{(pid=101666) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:36.359367 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Received port after_create {{(pid=101666) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:15:36.385782 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Pushing event updated for resources: {'Port': ['ID=0fc5f8ba-8da4-429f-903e-274bd4316a60,revision_number=1']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:36.419317 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Attempting to bind port 0fc5f8ba-8da4-429f-903e-274bd4316a60 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:15:36.419826 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Attempting to bind port 0fc5f8ba-8da4-429f-903e-274bd4316a60 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '0b48935c-b047-416c-af65-64437316f0d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:15:36.420232 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Attempting to bind port 0fc5f8ba-8da4-429f-903e-274bd4316a60 on network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:15:36.426148 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 15, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:15:36.426679 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Checking segment: {'id': '0b48935c-b047-416c-af65-64437316f0d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:15:36.427247 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.427702 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Bound using segment: {'id': '0b48935c-b047-416c-af65-64437316f0d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:15:36.428460 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Bound port: 0fc5f8ba-8da4-429f-903e-274bd4316a60, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0b48935c-b047-416c-af65-64437316f0d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:15:36.428908 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.481932 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.507527 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.509233 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] For port 0fc5f8ba-8da4-429f-903e-274bd4316a60, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:15:36.512719 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] For port 0fc5f8ba-8da4-429f-903e-274bd4316a60, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0fc5f8ba-8da4-429f-903e-274bd4316a60,segment=NetworkSegment(0b48935c-b047-416c-af65-64437316f0d9),segment_id=0b48935c-b047-416c-af65-64437316f0d9)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:15:36.607012 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.641121 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Allocated IP 172.27.2.72 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/4ce6477b-bc02-4335-b9e3-5322241456eb) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:15:36.719836 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-033f422b-cfef-493f-8c1f-44603a2b02cd None None] Pushing event updated for resources: {'Port': ['ID=0fc5f8ba-8da4-429f-903e-274bd4316a60,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:36.784836 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab157c54-5560-42ee-a598-a7ed6760ea43 req-3980d7fb-ee92-4143-b876-2d952ab077d7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:36.786654 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ab157c54-5560-42ee-a598-a7ed6760ea43 req-3980d7fb-ee92-4143-b876-2d952ab077d7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 944 time: 0.0958924 Nov 08 04:15:36.807612 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.866423 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ab157c54-5560-42ee-a598-a7ed6760ea43 req-7c21d845-2ba7-4390-b98c-2a3d0d09fc61 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0674803 Nov 08 04:15:36.937887 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:36.985661 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:36.991956 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:36.996523 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:15:37.040364 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Pushing event updated for resources: {'Port': ['ID=4ce6477b-bc02-4335-b9e3-5322241456eb,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:37.220239 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:37.289991 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:37.290378 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:37.372790 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0fc5f8ba-8da4-429f-903e-274bd4316a60 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:37.420066 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 0fc5f8ba-8da4-429f-903e-274bd4316a60 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:37.420432 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:37.498969 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:37.548297 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port 0fc5f8ba-8da4-429f-903e-274bd4316a60, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0fc5f8ba-8da4-429f-903e-274bd4316a60,segment=NetworkSegment(0b48935c-b047-416c-af65-64437316f0d9),segment_id=0b48935c-b047-416c-af65-64437316f0d9)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:37.667877 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:37.692372 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:37.759471 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=0fc5f8ba-8da4-429f-903e-274bd4316a60,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:37.788462 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aebd8028-4806-4ffe-b330-5782e80884d6 None None] Network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:15:37.877070 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-1485c75a-3a17-4417-b31c-e73fab317e4b None None] Provisioning complete for port 0fc5f8ba-8da4-429f-903e-274bd4316a60 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:37.878172 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1485c75a-3a17-4417-b31c-e73fab317e4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:37.891448 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-701612', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891'] for router, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:37.991133 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80a6ca07-7dc4-44c2-85e0-b0883a4e1269 req-49760163-1e9c-4064-a9ca-56446a59b587 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:37.992627 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80a6ca07-7dc4-44c2-85e0-b0883a4e1269 req-49760163-1e9c-4064-a9ca-56446a59b587 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 944 time: 0.0579445 Nov 08 04:15:38.051940 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80a6ca07-7dc4-44c2-85e0-b0883a4e1269 req-68cd616c-5996-47d8-841a-14abc2ff0a66 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531809 Nov 08 04:15:38.124417 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Router b550b3e0-0c49-4c38-a462-686bd574fc26 is scheduled to L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 with binding_index 1 {{(pid=101664) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 04:15:38.238871 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:15:38.248580 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Sync routers for ids ['b550b3e0-0c49-4c38-a462-686bd574fc26'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:15:38.266881 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Routers {'b550b3e0-0c49-4c38-a462-686bd574fc26'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:38.267489 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b550b3e0-0c49-4c38-a462-686bd574fc26'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:38.305595 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-1587cf16-eac5-4fb3-8d66-b3ecb131d484 None None] Provisioning complete for port 0fc5f8ba-8da4-429f-903e-274bd4316a60 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:38.305595 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1587cf16-eac5-4fb3-8d66-b3ecb131d484 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:38.327510 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:38.328859 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-fc19221e-f2ba-428e-9d0a-715d211d86fd admin admin] 10.222.0.21 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.6195953 Nov 08 04:15:38.331741 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55612) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:38.345352 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 8bfbc5de-2401-404d-81e1-3e4465bb44c8 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:15:38.559926 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Set router b550b3e0-0c49-4c38-a462-686bd574fc26 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:38.760317 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 8bfbc5de-2401-404d-81e1-3e4465bb44c8, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=8bfbc5de-2401-404d-81e1-3e4465bb44c8,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:38.764776 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:38.780823 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '8bfbc5de-2401-404d-81e1-3e4465bb44c8', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'port_id': '8bfbc5de-2401-404d-81e1-3e4465bb44c8', 'mac_address': 'fa:16:3e:e5:31:83', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 186, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:15:38.847397 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:38.865639 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8bfbc5de-2401-404d-81e1-3e4465bb44c8 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:15:38.881111 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'name': 'tempest-TestMinimumBasicScenario-1631031505-router', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:35Z', 'updated_at': '2021-11-08T04:15:37Z', 'revision_number': 3, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'gw_port': {'id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:25:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:36Z', 'updated_at': '2021-11-08T04:15:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:38.912587 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 8bfbc5de-2401-404d-81e1-3e4465bb44c8, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=8bfbc5de-2401-404d-81e1-3e4465bb44c8,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:38.913966 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Checking router: b550b3e0-0c49-4c38-a462-686bd574fc26 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:15:38.914310 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Updating router b550b3e0-0c49-4c38-a462-686bd574fc26 port 4ce6477b-bc02-4335-b9e3-5322241456eb binding host dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:15:38.926759 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Allocated IP 172.20.0.1 (473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd/abb984ac-8c1e-423f-8584-f542a644ade9/f6bbfa98-8445-4ae3-88e8-d9c876db8ebe) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:15:38.938684 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.019029 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.028441 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.100413 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=8bfbc5de-2401-404d-81e1-3e4465bb44c8,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:39.108741 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.160985 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0fc5f8ba-8da4-429f-903e-274bd4316a60 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:39.164021 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:39.167085 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:39.170624 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:15:39.217447 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Pushing event updated for resources: {'Port': ['ID=f6bbfa98-8445-4ae3-88e8-d9c876db8ebe,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:39.232884 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-703278'] for router_interface, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.257618 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9385093b-529f-44eb-8b70-8fb42b09eea3 req-a70405cf-da88-4147-b2ae-cb07f26b5fc3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:39.273429 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9385093b-529f-44eb-8b70-8fb42b09eea3 req-a70405cf-da88-4147-b2ae-cb07f26b5fc3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 945 time: 0.1109719 Nov 08 04:15:39.300051 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Publish callbacks [] for port, precommit_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.301686 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 0fc5f8ba-8da4-429f-903e-274bd4316a60 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:39.302042 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.364627 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9385093b-529f-44eb-8b70-8fb42b09eea3 req-499bf220-0da4-44da-a786-7b5eeabc2e76 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0894485 Nov 08 04:15:39.395296 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.460017 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Attempting to bind port 4ce6477b-bc02-4335-b9e3-5322241456eb on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:15:39.460386 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Attempting to bind port 4ce6477b-bc02-4335-b9e3-5322241456eb by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:15:39.460743 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Attempting to bind port 4ce6477b-bc02-4335-b9e3-5322241456eb on network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:15:39.462714 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Pushing event updated for resources: {'Port': ['ID=4ce6477b-bc02-4335-b9e3-5322241456eb,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:39.468009 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 15, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:15:39.468378 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:15:39.468771 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.469245 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Bound using segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:15:39.469662 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Bound port: 4ce6477b-bc02-4335-b9e3-5322241456eb, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:15:39.469955 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.520177 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] For port 4ce6477b-bc02-4335-b9e3-5322241456eb, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:15:39.523217 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] For port 4ce6477b-bc02-4335-b9e3-5322241456eb, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=4ce6477b-bc02-4335-b9e3-5322241456eb,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:15:39.531167 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.551558 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-4baa9e99-a205-48da-9ae8-8fce019329de None None] Provisioning complete for port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:39.552038 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-4baa9e99-a205-48da-9ae8-8fce019329de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.592015 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-4baa9e99-a205-48da-9ae8-8fce019329de None None] Port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:15:39.633338 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.688033 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Routers {'b550b3e0-0c49-4c38-a462-686bd574fc26'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:39.688661 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b550b3e0-0c49-4c38-a462-686bd574fc26'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:39.703545 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.724042 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Pushing event updated for resources: {'Port': ['ID=4ce6477b-bc02-4335-b9e3-5322241456eb,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:39.734323 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.734728 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.735078 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.735415 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.735749 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.736080 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.736417 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.737278 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.737609 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.737938 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.738263 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.738612 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2765985-ad69-4ee2-b620-b2d82b5943d1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:39.768495 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.812558 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] Set router b550b3e0-0c49-4c38-a462-686bd574fc26 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:39.831854 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Pushing event updated for resources: {'Port': ['ID=f6bbfa98-8445-4ae3-88e8-d9c876db8ebe,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:39.837327 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530987', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-703418'] for router_interface, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:39.940611 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:39.943057 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:40.016798 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'name': 'tempest-TestMinimumBasicScenario-1631031505-router', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:35Z', 'updated_at': '2021-11-08T04:15:39Z', 'revision_number': 4, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'gw_port': {'id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:25:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:36Z', 'updated_at': '2021-11-08T04:15:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f6bbfa98-8445-4ae3-88e8-d9c876db8ebe', 'name': '', 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'mac_address': 'fa:16:3e:79:96:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_interface', 'standard_attr_id': 424, 'fixed_ips': [{'subnet_id': 'abb984ac-8c1e-423f-8584-f542a644ade9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:38Z', 'updated_at': '2021-11-08T04:15:38Z', 'revision_number': 1, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'subnets': [{'id': 'abb984ac-8c1e-423f-8584-f542a644ade9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:40.048865 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9fa1151-d083-4ede-94ce-a90cd258c78c None None] The sync data for ids ['b550b3e0-0c49-4c38-a462-686bd574fc26'] in dv-cinder-783643-4-iscsi is: [{'id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'name': 'tempest-TestMinimumBasicScenario-1631031505-router', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:35Z', 'updated_at': '2021-11-08T04:15:39Z', 'revision_number': 4, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'gw_port': {'id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:25:79', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:36Z', 'updated_at': '2021-11-08T04:15:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f6bbfa98-8445-4ae3-88e8-d9c876db8ebe', 'name': '', 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'mac_address': 'fa:16:3e:79:96:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_interface', 'standard_attr_id': 424, 'fixed_ips': [{'subnet_id': 'abb984ac-8c1e-423f-8584-f542a644ade9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:38Z', 'updated_at': '2021-11-08T04:15:38Z', 'revision_number': 1, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'subnets': [{'id': 'abb984ac-8c1e-423f-8584-f542a644ade9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:15:40.074604 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Router b550b3e0-0c49-4c38-a462-686bd574fc26 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:15:40.184676 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:15:40.189615 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-2c98d875-bb4b-4272-a088-361d0f8fc146 admin admin] 10.222.0.21 "PUT /v2.0/routers/b550b3e0-0c49-4c38-a462-686bd574fc26/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8569138 Nov 08 04:15:40.215473 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-be5e4371-1a52-4c91-bd51-bdb8d06fdce5 None None] Provisioning complete for port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:40.215836 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-be5e4371-1a52-4c91-bd51-bdb8d06fdce5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:40.268647 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-be5e4371-1a52-4c91-bd51-bdb8d06fdce5 None None] Port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:15:40.406330 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55662) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:40.496676 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9c03c9-3f80-4600-8b7f-a9db054bf181 req-234e3a9e-ce52-42d3-8365-1c3c5cb1bbc0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:40.498925 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ff9c03c9-3f80-4600-8b7f-a9db054bf181 req-234e3a9e-ce52-42d3-8365-1c3c5cb1bbc0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 945 time: 0.0581498 Nov 08 04:15:40.542588 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-327ed0a2-1037-452b-8db2-21570c1cb115 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:40.567893 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ff9c03c9-3f80-4600-8b7f-a9db054bf181 req-0dc4f33a-adba-4e23-9abe-9d88813b7b3a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0615010 Nov 08 04:15:40.638066 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-327ed0a2-1037-452b-8db2-21570c1cb115 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:40.707594 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-327ed0a2-1037-452b-8db2-21570c1cb115 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:40.764364 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327ed0a2-1037-452b-8db2-21570c1cb115 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2acae71f-6b13-4578-b273-c10ded211663,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:40.771319 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-327ed0a2-1037-452b-8db2-21570c1cb115 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=ae3884306cac42e2bdb7af78c2f78d85&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3625572 Nov 08 04:15:40.772649 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55670) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:40.824451 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a2c931c3-b6ef-4da6-b0a6-eca2c1957102 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:40.849941 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a2c931c3-b6ef-4da6-b0a6-eca2c1957102 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:40.973122 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:15:40.976121 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a2c931c3-b6ef-4da6-b0a6-eca2c1957102 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:40.978715 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a2c931c3-b6ef-4da6-b0a6-eca2c1957102 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:40.982363 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a2c931c3-b6ef-4da6-b0a6-eca2c1957102 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/2acae71f-6b13-4578-b273-c10ded211663 HTTP/1.1" status: 204 len: 168 time: 0.2060211 Nov 08 04:15:40.990592 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2c931c3-b6ef-4da6-b0a6-eca2c1957102 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2acae71f-6b13-4578-b273-c10ded211663,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:41.163559 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 4ce6477b-bc02-4335-b9e3-5322241456eb up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:41.226100 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 4ce6477b-bc02-4335-b9e3-5322241456eb triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:41.226471 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:41.343143 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:41.369783 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port 4ce6477b-bc02-4335-b9e3-5322241456eb, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=4ce6477b-bc02-4335-b9e3-5322241456eb,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:41.450218 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:41.508909 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=4ce6477b-bc02-4335-b9e3-5322241456eb,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:41.598410 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['8bfbc5de-2401-404d-81e1-3e4465bb44c8'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:15:41.702888 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ef916b-7b2f-4392-a20f-2c9056d6867c req-a5f5e330-b85d-4429-b013-35e7feb89f9d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:41.711694 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48ef916b-7b2f-4392-a20f-2c9056d6867c req-a5f5e330-b85d-4429-b013-35e7feb89f9d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 945 time: 0.0608625 Nov 08 04:15:41.772970 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48ef916b-7b2f-4392-a20f-2c9056d6867c req-41a0c70a-78c6-4b77-8b6c-673a77244c4f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0600266 Nov 08 04:15:41.829333 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55696) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:41.865792 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-977c40a8-a4ca-48e0-ae8c-a5e1d0303637 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:42.006542 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-977c40a8-a4ca-48e0-ae8c-a5e1d0303637 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:42.084583 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-977c40a8-a4ca-48e0-ae8c-a5e1d0303637 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:42.128832 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-977c40a8-a4ca-48e0-ae8c-a5e1d0303637 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=4646d71cd15947f7905a85e1b1e10523&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2954297 Nov 08 04:15:42.128832 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-977c40a8-a4ca-48e0-ae8c-a5e1d0303637 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=220081d2-ef55-4acc-8211-9ac6c0c2c51d,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:42.129279 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55700) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:42.193852 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:42.217450 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:42.340477 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:42.343624 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:42.348526 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/220081d2-ef55-4acc-8211-9ac6c0c2c51d HTTP/1.1" status: 204 len: 168 time: 0.2178862 Nov 08 04:15:42.358145 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=220081d2-ef55-4acc-8211-9ac6c0c2c51d,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:42.366316 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.374172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.374172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.374172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.374172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.374172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.374172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.374709 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.374950 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.375280 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.375604 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.375923 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fab322d-be8d-4b15-aefa-1feada8932d3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:15:42.713574 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a695c4f7-29d5-448c-8095-665c86d7854a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:42.929357 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ed24fa-1202-4ce4-969b-4148d243718b req-3a1691bb-dd4f-4ea0-bf41-c283268b16ed tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:42.931131 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48ed24fa-1202-4ce4-969b-4148d243718b req-3a1691bb-dd4f-4ea0-bf41-c283268b16ed tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 945 time: 0.0627401 Nov 08 04:15:43.036236 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48ed24fa-1202-4ce4-969b-4148d243718b req-671bc967-b98f-479b-994b-65a1c886b566 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0972736 Nov 08 04:15:43.143824 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 4ce6477b-bc02-4335-b9e3-5322241456eb up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:43.223875 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 4ce6477b-bc02-4335-b9e3-5322241456eb triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:43.224325 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:43.277735 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 8bfbc5de-2401-404d-81e1-3e4465bb44c8 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:43.503514 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:15:43.510105 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:43.510806 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:43.641736 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:43.669934 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8bfbc5de-2401-404d-81e1-3e4465bb44c8'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:15:43.672653 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58926f0d-65bd-4ecd-ae64-336264b91d35" -d '{"events": [{"server_uuid": "e1b4ed4d-2888-42c9-bb24-200f03c9efe0", "name": "network-vif-plugged", "status": "completed", "tag": "8bfbc5de-2401-404d-81e1-3e4465bb44c8"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:15:43.689164 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 8bfbc5de-2401-404d-81e1-3e4465bb44c8, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=8bfbc5de-2401-404d-81e1-3e4465bb44c8,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:43.738327 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:15:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de706741-d9a0-4d08-ac9a-7385052888c2 x-openstack-request-id: req-de706741-d9a0-4d08-ac9a-7385052888c2 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:15:43.738959 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e1b4ed4d-2888-42c9-bb24-200f03c9efe0", "name": "network-vif-plugged", "status": "completed", "tag": "8bfbc5de-2401-404d-81e1-3e4465bb44c8", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:15:43.739044 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-de706741-d9a0-4d08-ac9a-7385052888c2 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:15:43.739452 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8bfbc5de-2401-404d-81e1-3e4465bb44c8', 'code': 200} Nov 08 04:15:43.753538 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:43.811366 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Sync routers for ids ['b550b3e0-0c49-4c38-a462-686bd574fc26'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:15:43.826190 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Routers {'b550b3e0-0c49-4c38-a462-686bd574fc26'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:43.826831 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b550b3e0-0c49-4c38-a462-686bd574fc26'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:43.848145 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=8bfbc5de-2401-404d-81e1-3e4465bb44c8,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:43.953365 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Set router b550b3e0-0c49-4c38-a462-686bd574fc26 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:44.278890 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-997f6aa1-cb97-4263-805a-4e36944ce7fe req-e5f64f11-32de-4019-b2f2-b6c022bee916 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:44.281646 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-997f6aa1-cb97-4263-805a-4e36944ce7fe req-e5f64f11-32de-4019-b2f2-b6c022bee916 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 1099 time: 0.1210496 Nov 08 04:15:44.320397 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'name': 'tempest-TestMinimumBasicScenario-1631031505-router', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:35Z', 'updated_at': '2021-11-08T04:15:39Z', 'revision_number': 4, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'gw_port': {'id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:25:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:36Z', 'updated_at': '2021-11-08T04:15:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f6bbfa98-8445-4ae3-88e8-d9c876db8ebe', 'name': '', 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'mac_address': 'fa:16:3e:79:96:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_interface', 'standard_attr_id': 424, 'fixed_ips': [{'subnet_id': 'abb984ac-8c1e-423f-8584-f542a644ade9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:38Z', 'updated_at': '2021-11-08T04:15:39Z', 'revision_number': 2, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'subnets': [{'id': 'abb984ac-8c1e-423f-8584-f542a644ade9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:44.327454 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2af77f2-72f9-428c-a28c-9a355aeef82b req-eb386c9f-cd55-48b1-8835-e097bb6c30f2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:44.329348 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a2af77f2-72f9-428c-a28c-9a355aeef82b req-eb386c9f-cd55-48b1-8835-e097bb6c30f2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 946 time: 0.1100345 Nov 08 04:15:44.369281 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-997f6aa1-cb97-4263-805a-4e36944ce7fe req-61d949f6-4ae5-4ff2-ab1b-052e286d9aaf service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0769055 Nov 08 04:15:44.375690 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Checking router: b550b3e0-0c49-4c38-a462-686bd574fc26 for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:15:44.376041 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Updating router b550b3e0-0c49-4c38-a462-686bd574fc26 port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe binding host dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:15:44.422103 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:44.484470 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a2af77f2-72f9-428c-a28c-9a355aeef82b req-289360cc-0703-46a0-b215-a835cf2fb95b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1135790 Nov 08 04:15:44.685940 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9506ff58-ae77-4e8f-985d-6448a752d43b req-f9a1455c-2ace-477c-b8b4-8641c7a7e0bf tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:44.690788 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9506ff58-ae77-4e8f-985d-6448a752d43b req-f9a1455c-2ace-477c-b8b4-8641c7a7e0bf tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0809667 Nov 08 04:15:44.758654 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9506ff58-ae77-4e8f-985d-6448a752d43b req-29ba3c22-ee57-45db-aeba-896f5f50ab99 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0613184 Nov 08 04:15:44.966573 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Publish callbacks [] for port, precommit_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:45.038274 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:45.155066 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11b7845a-1c65-432e-aa22-929ed4cc5c9a None None] Pushing event updated for resources: {'Port': ['ID=f6bbfa98-8445-4ae3-88e8-d9c876db8ebe,revision_number=3']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:45.188050 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Attempting to bind port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:15:45.188733 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Attempting to bind port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '0b48935c-b047-416c-af65-64437316f0d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd'}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:15:45.189254 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Attempting to bind port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe on network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:15:45.195633 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 15, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:15:45.196028 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Checking segment: {'id': '0b48935c-b047-416c-af65-64437316f0d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101667) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:15:45.196554 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:45.196995 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Bound using segment: {'id': '0b48935c-b047-416c-af65-64437316f0d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd'} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:15:45.197487 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Bound port: f6bbfa98-8445-4ae3-88e8-d9c876db8ebe, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0b48935c-b047-416c-af65-64437316f0d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 177, 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd'}}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:15:45.197888 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:45.305002 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] For port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101667) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:15:45.305002 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] For port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=f6bbfa98-8445-4ae3-88e8-d9c876db8ebe,segment=NetworkSegment(0b48935c-b047-416c-af65-64437316f0d9),segment_id=0b48935c-b047-416c-af65-64437316f0d9)] {{(pid=101667) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:15:45.359754 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-63478260-8852-4bca-b35e-4f1433870e6c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:45.375089 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-4c326374-c843-4393-a30c-65065c1eb361 None None] Provisioning complete for port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:45.375681 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-4c326374-c843-4393-a30c-65065c1eb361 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:45.388509 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:45.411076 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-4c326374-c843-4393-a30c-65065c1eb361 None None] Port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:15:45.472911 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11b7845a-1c65-432e-aa22-929ed4cc5c9a None None] Pushing event updated for resources: {'Port': ['ID=f6bbfa98-8445-4ae3-88e8-d9c876db8ebe,revision_number=4']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:45.487985 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Routers {'b550b3e0-0c49-4c38-a462-686bd574fc26'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:45.488878 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b550b3e0-0c49-4c38-a462-686bd574fc26'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:45.630234 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] Set router b550b3e0-0c49-4c38-a462-686bd574fc26 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:45.746519 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-67d85d07-d35f-403f-ac77-7f7c939c067a None None] Provisioning complete for port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:45.747666 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-67d85d07-d35f-403f-ac77-7f7c939c067a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:45.753825 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a92a84-a340-4bce-8b17-f2e7e29f12af req-b667f3bc-342c-46a6-b6ad-7a167ce745cf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:45.755659 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c1a92a84-a340-4bce-8b17-f2e7e29f12af req-b667f3bc-342c-46a6-b6ad-7a167ce745cf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 946 time: 0.1394789 Nov 08 04:15:45.886292 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c1a92a84-a340-4bce-8b17-f2e7e29f12af req-6f88ec31-5e6c-4089-8ef8-2ed863039289 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1203356 Nov 08 04:15:45.962500 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'name': 'tempest-TestMinimumBasicScenario-1631031505-router', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:35Z', 'updated_at': '2021-11-08T04:15:39Z', 'revision_number': 4, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'gw_port': {'id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:25:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:36Z', 'updated_at': '2021-11-08T04:15:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f6bbfa98-8445-4ae3-88e8-d9c876db8ebe', 'name': '', 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'mac_address': 'fa:16:3e:79:96:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_interface', 'standard_attr_id': 424, 'fixed_ips': [{'subnet_id': 'abb984ac-8c1e-423f-8584-f542a644ade9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:38Z', 'updated_at': '2021-11-08T04:15:45Z', 'revision_number': 4, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'subnets': [{'id': 'abb984ac-8c1e-423f-8584-f542a644ade9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:45.967986 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-67d85d07-d35f-403f-ac77-7f7c939c067a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:45.999701 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0ce398-1a73-41e2-9e44-2c632d241672 None None] The sync data for ids ['b550b3e0-0c49-4c38-a462-686bd574fc26'] in dv-cinder-783643-4-iscsi is: [{'id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'name': 'tempest-TestMinimumBasicScenario-1631031505-router', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:35Z', 'updated_at': '2021-11-08T04:15:39Z', 'revision_number': 4, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'gw_port': {'id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:25:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:36Z', 'updated_at': '2021-11-08T04:15:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f6bbfa98-8445-4ae3-88e8-d9c876db8ebe', 'name': '', 'network_id': '473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'mac_address': 'fa:16:3e:79:96:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_interface', 'standard_attr_id': 424, 'fixed_ips': [{'subnet_id': 'abb984ac-8c1e-423f-8584-f542a644ade9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:38Z', 'updated_at': '2021-11-08T04:15:45Z', 'revision_number': 4, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'subnets': [{'id': 'abb984ac-8c1e-423f-8584-f542a644ade9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:15:46.019870 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:46.022852 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-67d85d07-d35f-403f-ac77-7f7c939c067a None None] For port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=f6bbfa98-8445-4ae3-88e8-d9c876db8ebe,segment=NetworkSegment(0b48935c-b047-416c-af65-64437316f0d9),segment_id=0b48935c-b047-416c-af65-64437316f0d9)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:15:46.039719 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7993fc-42ae-4c2e-be76-7d65efa5a48e req-6a8a4c29-35b8-41b2-afcf-3f8be7d8dccf tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:46.044399 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d7993fc-42ae-4c2e-be76-7d65efa5a48e req-6a8a4c29-35b8-41b2-afcf-3f8be7d8dccf tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1111734 Nov 08 04:15:46.066231 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55806) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:46.079039 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-67d85d07-d35f-403f-ac77-7f7c939c067a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:46.133453 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d7993fc-42ae-4c2e-be76-7d65efa5a48e req-3a9c8eef-4775-41f2-8b54-2114a6cf8b78 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0821080 Nov 08 04:15:46.164280 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67d85d07-d35f-403f-ac77-7f7c939c067a None None] Pushing event updated for resources: {'Port': ['ID=f6bbfa98-8445-4ae3-88e8-d9c876db8ebe,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:46.260796 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f60a37d-f391-462d-b81d-b64195909ba5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:46.358081 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f60a37d-f391-462d-b81d-b64195909ba5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:46.440479 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f60a37d-f391-462d-b81d-b64195909ba5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:46.473391 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f60a37d-f391-462d-b81d-b64195909ba5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89daf7bf-f928-4c4a-baf2-490976460637,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:46.520135 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-7f60a37d-f391-462d-b81d-b64195909ba5 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=b0a80a0379df444da97297768d7c5fe8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4526343 Nov 08 04:15:46.522537 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55810) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:46.596561 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-32ee9ed6-7d54-41b9-9430-94e94f47c9d0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:46.623234 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-32ee9ed6-7d54-41b9-9430-94e94f47c9d0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:46.804608 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-32ee9ed6-7d54-41b9-9430-94e94f47c9d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:46.807643 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-32ee9ed6-7d54-41b9-9430-94e94f47c9d0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:46.808879 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-32ee9ed6-7d54-41b9-9430-94e94f47c9d0 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/89daf7bf-f928-4c4a-baf2-490976460637 HTTP/1.1" status: 204 len: 168 time: 0.2853196 Nov 08 04:15:46.817618 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ee9ed6-7d54-41b9-9430-94e94f47c9d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89daf7bf-f928-4c4a-baf2-490976460637,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:47.064065 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd953c5a-d2fa-4504-899a-46a25effd821 req-4b2ce06f-b5b4-4125-aad1-5c5baf41a9f5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:47.072786 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bd953c5a-d2fa-4504-899a-46a25effd821 req-4b2ce06f-b5b4-4125-aad1-5c5baf41a9f5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 946 time: 0.1049242 Nov 08 04:15:47.156139 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bd953c5a-d2fa-4504-899a-46a25effd821 req-81354a3d-8c4a-49b9-9281-5e2f3eddbda1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0823846 Nov 08 04:15:47.253011 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device f6bbfa98-8445-4ae3-88e8-d9c876db8ebe up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:15:47.357728 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:47.588742 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:47.589511 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ef4f6a-ef1b-424e-aa50-46708cb62e5e req-7ff7a4f2-d58e-4cc2-9b21-d399702eb7f9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:47.589511 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02ef4f6a-ef1b-424e-aa50-46708cb62e5e req-7ff7a4f2-d58e-4cc2-9b21-d399702eb7f9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 946 time: 0.1088202 Nov 08 04:15:47.589511 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c290af7d-285c-4e22-b05a-0e3263d14111 req-24fca89f-dc1d-4bcf-bedb-a1a38ae0bb45 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:47.589511 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c290af7d-285c-4e22-b05a-0e3263d14111 req-24fca89f-dc1d-4bcf-bedb-a1a38ae0bb45 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1081917 Nov 08 04:15:47.589511 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02ef4f6a-ef1b-424e-aa50-46708cb62e5e req-2f93522c-001e-4fdd-b7a9-54d277c6dbc3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0796282 Nov 08 04:15:47.589511 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c290af7d-285c-4e22-b05a-0e3263d14111 req-73c2a925-4f1e-4602-8768-320b8a88720c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0842586 Nov 08 04:15:47.590176 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55828) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:47.590176 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55832) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:47.712452 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-24cdfd0a-3d0a-4a9a-8993-223e231a310e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:47.803794 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-24cdfd0a-3d0a-4a9a-8993-223e231a310e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:47.821840 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:47.864329 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5fb34ed-58a0-4b17-8029-514eb8ba0cf6 tempest-TestVolumeBootPattern-2005605993 tempest-TestVolumeBootPattern-2005605993-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:47.865827 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f5fb34ed-58a0-4b17-8029-514eb8ba0cf6 tempest-TestVolumeBootPattern-2005605993 tempest-TestVolumeBootPattern-2005605993-project-admin] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 1094 time: 0.2834458 Nov 08 04:15:47.869171 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55836) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:47.875728 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'floatingip': {'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'port_id': '8bfbc5de-2401-404d-81e1-3e4465bb44c8', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address': '172.20.0.13'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:15:47.894529 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-24cdfd0a-3d0a-4a9a-8993-223e231a310e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:47.953201 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-24cdfd0a-3d0a-4a9a-8993-223e231a310e admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=af4a0e468d1d48efbd0602c061e8f159&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3810868 Nov 08 04:15:47.956140 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 55838) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:47.956294 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24cdfd0a-3d0a-4a9a-8993-223e231a310e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b19f2a59-3b9b-486a-8f95-ddd0fe1860a7,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:48.027204 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9b777d4b-7652-4806-abec-3c4df9ff2ea4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.032323 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.055789 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55840) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:48.070537 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-249aafb9-2893-4387-a622-42b289dfc6d3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.082236 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9b777d4b-7652-4806-abec-3c4df9ff2ea4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.161103 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-249aafb9-2893-4387-a622-42b289dfc6d3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.196675 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.260422 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-249aafb9-2893-4387-a622-42b289dfc6d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.292766 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9b777d4b-7652-4806-abec-3c4df9ff2ea4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.298701 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9b777d4b-7652-4806-abec-3c4df9ff2ea4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.302223 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-9b777d4b-7652-4806-abec-3c4df9ff2ea4 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/b19f2a59-3b9b-486a-8f95-ddd0fe1860a7 HTTP/1.1" status: 204 len: 168 time: 0.3434782 Nov 08 04:15:48.302374 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-249aafb9-2893-4387-a622-42b289dfc6d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b382293-2d7b-4a81-9c98-19ae7324195b,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:48.322185 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-249aafb9-2893-4387-a622-42b289dfc6d3 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=8820888f671a44a391c633d5d5db951f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2652822 Nov 08 04:15:48.335096 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 55844) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:48.352218 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b777d4b-7652-4806-abec-3c4df9ff2ea4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b19f2a59-3b9b-486a-8f95-ddd0fe1860a7,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:48.405137 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.431466 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-05391584-83af-4ac0-b35f-3f8e58d196ec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.453874 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-05391584-83af-4ac0-b35f-3f8e58d196ec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.461481 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Allocated IP 172.27.2.57 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/ee079b89-6120-4191-934c-66e56a75fbe4) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:15:48.587822 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-05391584-83af-4ac0-b35f-3f8e58d196ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.589825 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.592055 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-05391584-83af-4ac0-b35f-3f8e58d196ec admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.594297 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-05391584-83af-4ac0-b35f-3f8e58d196ec admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/8b382293-2d7b-4a81-9c98-19ae7324195b HTTP/1.1" status: 204 len: 168 time: 0.2579849 Nov 08 04:15:48.629740 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05391584-83af-4ac0-b35f-3f8e58d196ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b382293-2d7b-4a81-9c98-19ae7324195b,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:48.729056 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:48.786766 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:48.790602 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:48.799844 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da5777d-2cbd-4472-a1d5-7c2a309f491f req-61c1c913-7ce8-4ce7-8dbf-51278af1f5d2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:48.802968 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7da5777d-2cbd-4472-a1d5-7c2a309f491f req-61c1c913-7ce8-4ce7-8dbf-51278af1f5d2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1045973 Nov 08 04:15:48.808156 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:15:48.836155 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'Port': ['ID=ee079b89-6120-4191-934c-66e56a75fbe4,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:48.920990 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7da5777d-2cbd-4472-a1d5-7c2a309f491f req-2ed3722f-8fb6-44f6-8066-9c740b8128a2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1088076 Nov 08 04:15:49.683523 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:49.889509 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:50.112431 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:50.131069 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4ce894-24c9-4867-b34f-3f8108e9c1c9 req-99f3ae14-195b-4f3b-995f-0063b3734afb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:50.132801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2e4ce894-24c9-4867-b34f-3f8108e9c1c9 req-99f3ae14-195b-4f3b-995f-0063b3734afb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1194894 Nov 08 04:15:50.170107 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:50.285108 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:50.398081 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2e4ce894-24c9-4867-b34f-3f8108e9c1c9 req-2ea26766-98e4-4cfa-be08-9a9ee18dbb8c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2519867 Nov 08 04:15:50.413940 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'Port': ['ID=ee079b89-6120-4191-934c-66e56a75fbe4,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:50.449771 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Floating IP a902f47b-ca98-4cce-a6ab-f1dcc615bfa4 associated. External IP: 172.27.2.57, port: 8bfbc5de-2401-404d-81e1-3e4465bb44c8. Nov 08 04:15:50.726873 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Router 8aa2c265-b728-4ac3-97de-f276d80d2037 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:15:50.850187 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:15:50.855543 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] Sync routers for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:15:50.884123 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:50.884777 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:50.956014 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:51.025515 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-143f2dcf-44c1-4b8c-b088-d41ba4afd316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.1547372 Nov 08 04:15:51.026464 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'tag': '8bfbc5de-2401-404d-81e1-3e4465bb44c8'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:15:51.028821 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e5a56e46-6f94-46d7-adce-a44ea8667611" -d '{"events": [{"name": "network-changed", "server_uuid": "e1b4ed4d-2888-42c9-bb24-200f03c9efe0", "tag": "8bfbc5de-2401-404d-81e1-3e4465bb44c8"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:15:51.043464 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:51.126981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:15:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-66113b54-d1db-45a3-83ce-22f0f87b929b x-openstack-request-id: req-66113b54-d1db-45a3-83ce-22f0f87b929b {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:15:51.127486 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e1b4ed4d-2888-42c9-bb24-200f03c9efe0", "tag": "8bfbc5de-2401-404d-81e1-3e4465bb44c8", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:15:51.128417 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-66113b54-d1db-45a3-83ce-22f0f87b929b {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:15:51.129063 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'tag': '8bfbc5de-2401-404d-81e1-3e4465bb44c8', 'status': 'completed', 'code': 200} Nov 08 04:15:51.280619 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-1aaafd60-aafe-4553-bd31-a866dd7f515e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:51.282100 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-1aaafd60-aafe-4553-bd31-a866dd7f515e service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 1099 time: 0.0988345 Nov 08 04:15:51.444653 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': 'a902f47b-ca98-4cce-a6ab-f1dcc615bfa4', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.57', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '8bfbc5de-2401-404d-81e1-3e4465bb44c8', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:e5:31:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:15:49Z', 'updated_at': '2021-11-08T04:15:49Z', 'revision_number': 0, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:51.456861 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] Checking router: 8aa2c265-b728-4ac3-97de-f276d80d2037 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:15:51.468179 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:15:51.469051 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:15:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:51.481483 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-e035855d-9fd3-4b63-b5b1-f760d52a047e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:51.483912 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-e035855d-9fd3-4b63-b5b1-f760d52a047e service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.1898685 Nov 08 04:15:51.613241 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:15:51.624646 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-c869568d-2b38-4184-9ad3-19467bc7b4ad service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=8bfbc5de-2401-404d-81e1-3e4465bb44c8 HTTP/1.1" status: 200 len: 999 time: 0.1261547 Nov 08 04:15:51.633090 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9f09672-6ea0-414f-ab8c-6060e9c55955 req-66302f06-8077-417b-997e-573af23de4c1 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:51.634916 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d9f09672-6ea0-414f-ab8c-6060e9c55955 req-66302f06-8077-417b-997e-573af23de4c1 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1451623 Nov 08 04:15:51.712488 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-468fcb43-4b1a-487e-b890-eb5b10d275e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:51.713923 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-468fcb43-4b1a-487e-b890-eb5b10d275e5 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0779200 Nov 08 04:15:51.722605 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d9f09672-6ea0-414f-ab8c-6060e9c55955 req-9bbfed0c-087e-4e79-ba7a-faa51c669df0 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0772099 Nov 08 04:15:51.778250 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-9676b917-7725-4bf3-8dfb-9065e87b0f2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:51.781876 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-9676b917-7725-4bf3-8dfb-9065e87b0f2c service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0579002 Nov 08 04:15:51.915969 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-ba4d7dba-33f4-42ce-808e-b8b7529ed3a3 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1229405 Nov 08 04:15:52.024217 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5a56e46-6f94-46d7-adce-a44ea8667611 req-af7c878e-b2bd-4cca-99eb-d54dacf69129 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0999284 Nov 08 04:15:52.070513 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': 'a902f47b-ca98-4cce-a6ab-f1dcc615bfa4', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.57', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '8bfbc5de-2401-404d-81e1-3e4465bb44c8', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:e5:31:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:15:49Z', 'updated_at': '2021-11-08T04:15:49Z', 'revision_number': 0, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:15:52.101842 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae736961-ff6f-4776-a3a9-be78b0323c02 None None] The sync data for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi is: [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': 'a902f47b-ca98-4cce-a6ab-f1dcc615bfa4', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.57', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '8bfbc5de-2401-404d-81e1-3e4465bb44c8', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 451, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:e5:31:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:15:49Z', 'updated_at': '2021-11-08T04:15:49Z', 'revision_number': 0, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:15:52.378521 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8227b7a7-a7a8-44db-b862-684d298c96e4 None None] New status for floating IP a902f47b-ca98-4cce-a6ab-f1dcc615bfa4: ACTIVE {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:15:52.871771 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d6782ee-77a4-4dcb-88b1-69112de26f3b req-16241f27-b4fe-4577-9350-173487001d9c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:52.879073 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4d6782ee-77a4-4dcb-88b1-69112de26f3b req-16241f27-b4fe-4577-9350-173487001d9c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0707908 Nov 08 04:15:52.942301 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4d6782ee-77a4-4dcb-88b1-69112de26f3b req-a3f60778-46a6-4f88-84ac-52a05b84edca tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0621903 Nov 08 04:15:54.098903 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-413942ae-99cf-486f-a03d-cc2f229d7903 req-6cb71126-57a6-4fc0-b98c-6b820a4bb04f tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:54.100417 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-413942ae-99cf-486f-a03d-cc2f229d7903 req-6cb71126-57a6-4fc0-b98c-6b820a4bb04f tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0836961 Nov 08 04:15:54.175569 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-413942ae-99cf-486f-a03d-cc2f229d7903 req-99501a5a-98b0-4384-9fdc-d18b6f51709c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0646410 Nov 08 04:15:54.250366 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:55.355900 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961aa592-b4a5-4040-9696-de6b34bef85a req-cab36e15-dd76-489d-a2af-312fe4fbf749 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:55.357503 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-961aa592-b4a5-4040-9696-de6b34bef85a req-cab36e15-dd76-489d-a2af-312fe4fbf749 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1194634 Nov 08 04:15:55.406122 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-88423181-4503-40a6-a19e-acef1130366d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:55.407657 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-88423181-4503-40a6-a19e-acef1130366d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/networks?id=92ef9e7b-7c26-4986-b683-d2777b2485f6 HTTP/1.1" status: 200 len: 815 time: 0.1599495 Nov 08 04:15:55.434219 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-94eed0a8-a824-4eb0-9c7a-3348d009c790 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/quotas/d23a714c188845279fa19f9c87df4def HTTP/1.1" status: 200 len: 375 time: 0.0208449 Nov 08 04:15:55.437890 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-961aa592-b4a5-4040-9696-de6b34bef85a req-d89f766b-ff51-4b19-a39e-f6513fdf074c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0739241 Nov 08 04:15:55.490083 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-985ea9a9-ce9f-4737-97f2-219e13be9890 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=d23a714c188845279fa19f9c87df4def&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0503154 Nov 08 04:15:55.584016 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9a0b6ff6-150b-4f0e-a094-50eee163e9bb service neutron] 10.222.0.21 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798604 Nov 08 04:15:55.673425 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-c09750c8-f980-4a52-b0b2-aacfc3ca45ce service neutron] 10.222.0.21 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854237 Nov 08 04:15:55.916710 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e95672d4-b974-4083-983a-1c7654dfc735 req-e2729afa-540b-4ad1-bcb2-b840ce20468d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 210 time: 0.0351074 Nov 08 04:15:56.566917 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a454900a-9caf-4f9b-ac3a-25ef12e04d23 req-bcf8bdad-0fb7-4ff6-b2af-d26d6f208168 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:56.566917 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a454900a-9caf-4f9b-ac3a-25ef12e04d23 req-bcf8bdad-0fb7-4ff6-b2af-d26d6f208168 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0521677 Nov 08 04:15:56.611348 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a454900a-9caf-4f9b-ac3a-25ef12e04d23 req-92a13edd-937a-4771-87e4-1465802f9932 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435839 Nov 08 04:15:57.028884 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4963515f-3dbe-4726-9a46-dbd276a3166e req-74c676e3-5389-42fe-955b-5dd246396867 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 210 time: 0.0483561 Nov 08 04:15:57.055533 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e8a80b7-4d3f-491f-bd69-b59bb2d44234 req-4caec03d-b292-4b2f-9ce9-e297248498f4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:57.057046 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5e8a80b7-4d3f-491f-bd69-b59bb2d44234 req-4caec03d-b292-4b2f-9ce9-e297248498f4 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1027064 Nov 08 04:15:57.129028 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5e8a80b7-4d3f-491f-bd69-b59bb2d44234 req-47daa843-9a8d-4a38-9c5c-38af5e859cbf tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0653412 Nov 08 04:15:57.159314 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-14b6c589-8a0c-408b-ba25-e1161ce9e376 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:57.161021 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-14b6c589-8a0c-408b-ba25-e1161ce9e376 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 1098 time: 0.0442450 Nov 08 04:15:57.274509 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-b2b8e9f9-0f08-45ae-be1c-fb04b7141680 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:57.274509 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-b2b8e9f9-0f08-45ae-be1c-fb04b7141680 service neutron] 10.222.0.16 "GET /v2.0/networks?id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f HTTP/1.1" status: 200 len: 912 time: 0.0978389 Nov 08 04:15:57.301747 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56094) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:57.354021 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-dcc25288-ec37-40f1-8f13-44a6acdfc223 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d997f4bb-f698-4538-b9ae-f08bec1d6ff6 HTTP/1.1" status: 200 len: 1000 time: 0.0705740 Nov 08 04:15:57.413866 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-a0ccdb09-e4da-4a22-9c6e-76339930adb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:57.415580 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-a0ccdb09-e4da-4a22-9c6e-76339930adb5 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=1158e941-c129-49d0-9b8b-ba72d0ef6717 HTTP/1.1" status: 200 len: 850 time: 0.0543118 Nov 08 04:15:57.425247 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-1567717a-87be-477d-8546-bae5465d274a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:57.476901 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-74de18ef-5c76-4744-ab5b-9cb39acd2eb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:57.478406 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-74de18ef-5c76-4744-ab5b-9cb39acd2eb2 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0542526 Nov 08 04:15:57.505537 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-1567717a-87be-477d-8546-bae5465d274a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:57.576935 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-c4eb61ea-bc4a-49e2-9a57-02346b2209d2 service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860219 Nov 08 04:15:57.593252 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-1567717a-87be-477d-8546-bae5465d274a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:57.631228 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1567717a-87be-477d-8546-bae5465d274a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b97f070-9f42-41f3-97ec-e1cbaae317e4,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:57.640281 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-1567717a-87be-477d-8546-bae5465d274a admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=b0e945e4d7c143438f060c6fe8545f1b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3373640 Nov 08 04:15:57.641376 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56106) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:57.690908 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e874866-82ab-42b6-9a10-cfe07c91adf7 req-4898d0fc-f8c0-424c-a596-231df157cc58 service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1006200 Nov 08 04:15:57.697278 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a60c9305-5fba-4a24-bbc6-5e904b5c1158 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:57.724040 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a60c9305-5fba-4a24-bbc6-5e904b5c1158 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:57.844464 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a60c9305-5fba-4a24-bbc6-5e904b5c1158 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:57.847336 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a60c9305-5fba-4a24-bbc6-5e904b5c1158 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:57.848562 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a60c9305-5fba-4a24-bbc6-5e904b5c1158 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/7b97f070-9f42-41f3-97ec-e1cbaae317e4 HTTP/1.1" status: 204 len: 168 time: 0.2061555 Nov 08 04:15:57.856726 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a60c9305-5fba-4a24-bbc6-5e904b5c1158 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b97f070-9f42-41f3-97ec-e1cbaae317e4,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:58.126375 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31c85b86-cbac-4151-8e6e-803c735ecd75 req-764526f7-7713-4150-b500-68863f0bca09 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 210 time: 0.0270760 Nov 08 04:15:58.248633 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af98a195-4daa-406e-9025-fb50e853f86a req-839e57ee-569f-4e87-896c-4d5995f3f3d2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:58.250009 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af98a195-4daa-406e-9025-fb50e853f86a req-839e57ee-569f-4e87-896c-4d5995f3f3d2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0512698 Nov 08 04:15:58.295869 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af98a195-4daa-406e-9025-fb50e853f86a req-9dcd9fbd-811d-4305-8c4e-e7ac8d740a59 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391233 Nov 08 04:15:58.451150 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56134) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:58.467747 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0de84a14-12e3-4d35-b93d-248b8ee0aa15 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:58.567502 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0de84a14-12e3-4d35-b93d-248b8ee0aa15 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:58.634752 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-f712842b-bfbc-4495-b789-cb3a3634cf4f tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:58.636176 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-f712842b-bfbc-4495-b789-cb3a3634cf4f tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.16 "GET /v2.0/networks?id=92ef9e7b-7c26-4986-b683-d2777b2485f6 HTTP/1.1" status: 200 len: 815 time: 0.1089542 Nov 08 04:15:58.664585 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'port': {'device_id': '9cf104fc-d344-4175-ab31-20087fd691b4', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'admin_state_up': True, 'tenant_id': 'd23a714c188845279fa19f9c87df4def'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:15:58.725080 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0de84a14-12e3-4d35-b93d-248b8ee0aa15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:58.785794 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-0de84a14-12e3-4d35-b93d-248b8ee0aa15 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=0b298409444f4816a3c1b420e674ceaf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3335233 Nov 08 04:15:58.788424 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56136) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:58.791112 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de84a14-12e3-4d35-b93d-248b8ee0aa15 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=189f39e1-f296-4689-8851-ac6f3fea1602,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:58.835593 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b395ebb3-46af-4276-b480-8bf462d32a46 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:58.857088 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b395ebb3-46af-4276-b480-8bf462d32a46 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:58.918940 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Made reservation on behalf of d23a714c188845279fa19f9c87df4def for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:15:58.922614 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:58.987565 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b395ebb3-46af-4276-b480-8bf462d32a46 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:58.990238 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b395ebb3-46af-4276-b480-8bf462d32a46 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:58.991496 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-b395ebb3-46af-4276-b480-8bf462d32a46 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/189f39e1-f296-4689-8851-ac6f3fea1602 HTTP/1.1" status: 204 len: 168 time: 0.2020924 Nov 08 04:15:59.000026 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b395ebb3-46af-4276-b480-8bf462d32a46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=189f39e1-f296-4689-8851-ac6f3fea1602,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:59.112740 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Allocated IP 172.20.0.10 (92ef9e7b-7c26-4986-b683-d2777b2485f6/80d1402e-d73c-4668-9cb6-646683e6398f/0afc78c5-30fe-44b8-be25-b6544e0efa0e) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:15:59.241870 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4fcab93e-06a2-49f6-a0dc-1dba3399b5b2 req-bd1ff0ea-4f4d-4a27-b6d8-3491a752dea3 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 210 time: 0.0330913 Nov 08 04:15:59.285293 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:59.388330 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:59.471242 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Network 92ef9e7b-7c26-4986-b683-d2777b2485f6 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:15:59.482534 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a8c1867-bed9-4b8a-bcbb-123fa7643b95 req-11f972d7-ae20-486e-9fec-03f22ad9e4c7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:59.484289 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8a8c1867-bed9-4b8a-bcbb-123fa7643b95 req-11f972d7-ae20-486e-9fec-03f22ad9e4c7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1079876 Nov 08 04:15:59.485157 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:15:59.487439 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'Port': ['ID=0afc78c5-30fe-44b8-be25-b6544e0efa0e,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:15:59.489567 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:15:59.562146 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:15:59.562770 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:59.588426 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8a8c1867-bed9-4b8a-bcbb-123fa7643b95 req-88e0abe1-3346-4a7d-b81f-df79a162efc0 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0947218 Nov 08 04:15:59.709439 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8c026d6a-cc54-41a9-9f67-5e4920638a3a None None] Provisioning complete for port 0afc78c5-30fe-44b8-be25-b6544e0efa0e triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:15:59.711776 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8c026d6a-cc54-41a9-9f67-5e4920638a3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:59.722727 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-b950f0e8-41a6-40dd-8bec-bb6d10a35ebc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0616338 Nov 08 04:15:59.795610 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8c026d6a-cc54-41a9-9f67-5e4920638a3a None None] Port 0afc78c5-30fe-44b8-be25-b6544e0efa0e cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:15:59.831288 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56176) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:15:59.844899 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2ebd6c83-f088-4cc7-ad5b-fdf61374ce6f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:59.925798 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2ebd6c83-f088-4cc7-ad5b-fdf61374ce6f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:15:59.998730 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2ebd6c83-f088-4cc7-ad5b-fdf61374ce6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:00.040827 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-2ebd6c83-f088-4cc7-ad5b-fdf61374ce6f admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=9cf5c069f9344727b787cbda73c3d3fe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2082417 Nov 08 04:16:00.042737 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56178) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:00.049077 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ebd6c83-f088-4cc7-ad5b-fdf61374ce6f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=512ee653-4fa0-4145-a86c-8a37d4788f19,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:00.100666 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-29d16e12-086e-429b-b054-de2b7356471a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:00.122091 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-29d16e12-086e-429b-b054-de2b7356471a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:00.239112 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-29d16e12-086e-429b-b054-de2b7356471a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:00.241978 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-29d16e12-086e-429b-b054-de2b7356471a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:00.243234 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-29d16e12-086e-429b-b054-de2b7356471a admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/512ee653-4fa0-4145-a86c-8a37d4788f19 HTTP/1.1" status: 204 len: 168 time: 0.1989875 Nov 08 04:16:00.252079 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d16e12-086e-429b-b054-de2b7356471a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=512ee653-4fa0-4145-a86c-8a37d4788f19,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:00.372703 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da1f93e-c624-4309-a4ab-ebaa6becb32c req-adc354fb-c24b-495c-ab21-c79b49bcca4c tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:00.374249 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3da1f93e-c624-4309-a4ab-ebaa6becb32c req-adc354fb-c24b-495c-ab21-c79b49bcca4c tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0579200 Nov 08 04:16:00.430233 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3da1f93e-c624-4309-a4ab-ebaa6becb32c req-ff87fac3-7703-4c83-807a-ae859b0b0b9d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493460 Nov 08 04:16:01.589201 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-284f2992-d778-4447-8c1a-1ef8269926a9 req-ed50e391-eff4-4d7e-b1f1-580f5dfe5b83 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:01.590699 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-284f2992-d778-4447-8c1a-1ef8269926a9 req-ed50e391-eff4-4d7e-b1f1-580f5dfe5b83 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0526099 Nov 08 04:16:01.642094 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-284f2992-d778-4447-8c1a-1ef8269926a9 req-f94f3bfb-e10a-44f0-b99a-ba00b9023b66 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447159 Nov 08 04:16:02.528605 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56236) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:02.693286 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-29229835-5c95-4434-aabd-7c02ca05e97e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:02.807761 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5078c4fd-2c9a-4740-883d-c63b73341689 req-96930ca5-9f0a-4ba9-a809-43f3c191643f tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:02.816187 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5078c4fd-2c9a-4740-883d-c63b73341689 req-96930ca5-9f0a-4ba9-a809-43f3c191643f tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0994334 Nov 08 04:16:03.101615 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-29229835-5c95-4434-aabd-7c02ca05e97e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:03.156178 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5078c4fd-2c9a-4740-883d-c63b73341689 req-621d274c-d775-4d5d-be7d-26fee4719ba4 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3240266 Nov 08 04:16:03.197678 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-29229835-5c95-4434-aabd-7c02ca05e97e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:03.237839 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-29229835-5c95-4434-aabd-7c02ca05e97e admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=6e92a4f5b3544d388e819365a28655f1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7081146 Nov 08 04:16:03.238721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29229835-5c95-4434-aabd-7c02ca05e97e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07659127-5144-43bd-b645-efb603b01c49,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:03.240595 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56252) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:03.308075 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dad3bdb7-4c20-4b99-838e-1ab49871d9e7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:03.331947 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dad3bdb7-4c20-4b99-838e-1ab49871d9e7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:03.461999 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dad3bdb7-4c20-4b99-838e-1ab49871d9e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:03.464798 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dad3bdb7-4c20-4b99-838e-1ab49871d9e7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:03.465923 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-dad3bdb7-4c20-4b99-838e-1ab49871d9e7 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/07659127-5144-43bd-b645-efb603b01c49 HTTP/1.1" status: 204 len: 168 time: 0.2243443 Nov 08 04:16:03.478842 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dad3bdb7-4c20-4b99-838e-1ab49871d9e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07659127-5144-43bd-b645-efb603b01c49,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:04.254827 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e69cff06-f96a-46a3-8a3a-b997106843be req-bbebb7fa-c2b0-4f31-be7f-8c8936852908 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:04.256320 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e69cff06-f96a-46a3-8a3a-b997106843be req-bbebb7fa-c2b0-4f31-be7f-8c8936852908 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0480413 Nov 08 04:16:04.300603 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e69cff06-f96a-46a3-8a3a-b997106843be req-cf3fe14d-56ff-406d-bd75-fe97ba24849c tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385714 Nov 08 04:16:05.428641 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-899fd537-4214-4126-bad5-7903dbdc2865 req-b8b06c58-6d6a-4864-996e-47363731c365 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:05.430301 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-899fd537-4214-4126-bad5-7903dbdc2865 req-b8b06c58-6d6a-4864-996e-47363731c365 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0531845 Nov 08 04:16:05.503927 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-899fd537-4214-4126-bad5-7903dbdc2865 req-d7989b0f-9b90-476c-bf5d-ffb0c2a69274 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604064 Nov 08 04:16:06.646851 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4f1886-4c98-44e6-9cb0-ff157dbe864a req-0d0c381e-75b4-4065-bfcb-99029e07bee3 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:06.648589 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fe4f1886-4c98-44e6-9cb0-ff157dbe864a req-0d0c381e-75b4-4065-bfcb-99029e07bee3 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0555336 Nov 08 04:16:06.697462 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fe4f1886-4c98-44e6-9cb0-ff157dbe864a req-53502529-1f3c-4288-a3ba-568ea1558ce4 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429652 Nov 08 04:16:07.816564 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ca1feaa-fc3f-4751-8ac9-d749e7f9c006 req-be857fc7-0d38-4052-91b5-f60dd672e0e8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:07.818012 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ca1feaa-fc3f-4751-8ac9-d749e7f9c006 req-be857fc7-0d38-4052-91b5-f60dd672e0e8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0496557 Nov 08 04:16:07.864592 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ca1feaa-fc3f-4751-8ac9-d749e7f9c006 req-2e938ddc-36ad-4e4c-8de8-f9896cc4d74c tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407960 Nov 08 04:16:08.989589 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ff13691-b5ac-4f64-bbd2-2e64870633ef req-4ad118d0-88c6-4edf-84ce-0d22d411052f tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:08.991237 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ff13691-b5ac-4f64-bbd2-2e64870633ef req-4ad118d0-88c6-4edf-84ce-0d22d411052f tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0527439 Nov 08 04:16:09.046183 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ff13691-b5ac-4f64-bbd2-2e64870633ef req-1a135468-4a4e-4ed4-96dd-2a688eb0f5b7 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486858 Nov 08 04:16:10.182197 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c316c956-5d17-4d4d-8709-0ffcd5b6ffa9 req-3d5a3677-cee7-45b6-a18f-eb712de19270 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:10.184262 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c316c956-5d17-4d4d-8709-0ffcd5b6ffa9 req-3d5a3677-cee7-45b6-a18f-eb712de19270 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0703821 Nov 08 04:16:10.253315 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c316c956-5d17-4d4d-8709-0ffcd5b6ffa9 req-c4310d09-a3ae-4d76-ab76-809e84754003 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624824 Nov 08 04:16:11.409730 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9b40ed-86e2-492f-a01a-63c80304014e req-9b293d45-ad6a-45d4-a988-6dad6570abbc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:11.409730 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ca9b40ed-86e2-492f-a01a-63c80304014e req-9b293d45-ad6a-45d4-a988-6dad6570abbc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0796175 Nov 08 04:16:11.459549 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ca9b40ed-86e2-492f-a01a-63c80304014e req-faba93cd-f9bb-4f19-809d-2efe55a30e53 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506008 Nov 08 04:16:12.585549 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5235d6c4-a308-4644-b685-1a2891853939 req-4bfe0be0-5224-494f-824e-056ea4cb73fa tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:12.587514 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5235d6c4-a308-4644-b685-1a2891853939 req-4bfe0be0-5224-494f-824e-056ea4cb73fa tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 932 time: 0.0526769 Nov 08 04:16:12.635710 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5235d6c4-a308-4644-b685-1a2891853939 req-21c40ea3-5854-46a9-aeff-360d22160c82 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423782 Nov 08 04:16:12.690168 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-93d29e55-8ede-4884-a20a-c6ca64453f6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:12.831354 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56376) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:12.932643 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e0c743ab-1e6d-4452-a3a6-1ac01746d1aa admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.002461 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e0c743ab-1e6d-4452-a3a6-1ac01746d1aa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.061091 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e0c743ab-1e6d-4452-a3a6-1ac01746d1aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.097700 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e0c743ab-1e6d-4452-a3a6-1ac01746d1aa admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=ca07e9d1b85840d8ba8f49efcdade5bf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2646856 Nov 08 04:16:13.099631 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0c743ab-1e6d-4452-a3a6-1ac01746d1aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3073be81-5283-4a6d-b9e5-1076ea73135f,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:13.100486 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56380) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:13.147928 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d60784f6-a88a-4ab9-99db-1aa88bc78973 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.168067 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d60784f6-a88a-4ab9-99db-1aa88bc78973 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.244850 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Request body: {'port': {'device_id': '9cf104fc-d344-4175-ab31-20087fd691b4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:13.297050 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.298924 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d60784f6-a88a-4ab9-99db-1aa88bc78973 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.301998 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d60784f6-a88a-4ab9-99db-1aa88bc78973 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.305422 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-d60784f6-a88a-4ab9-99db-1aa88bc78973 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/3073be81-5283-4a6d-b9e5-1076ea73135f HTTP/1.1" status: 204 len: 168 time: 0.2016430 Nov 08 04:16:13.320066 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60784f6-a88a-4ab9-99db-1aa88bc78973 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3073be81-5283-4a6d-b9e5-1076ea73135f,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:13.570652 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0afc78c5-30fe-44b8-be25-b6544e0efa0e {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:16:13.577775 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.591738 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Transition to ACTIVE for port object 0afc78c5-30fe-44b8-be25-b6544e0efa0e will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:16:13.667588 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.740513 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Pushing event updated for resources: {'Port': ['ID=0afc78c5-30fe-44b8-be25-b6544e0efa0e,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:13.803708 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9738d3f-4d6f-4961-a705-6f895cfc6db8 req-b77bb7f1-0ee2-40f5-80c7-47ac15f8b58d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:13.808177 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a9738d3f-4d6f-4961-a705-6f895cfc6db8 req-b77bb7f1-0ee2-40f5-80c7-47ac15f8b58d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 944 time: 0.1015513 Nov 08 04:16:13.850391 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Attempting to bind port 0afc78c5-30fe-44b8-be25-b6544e0efa0e on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:16:13.850760 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Attempting to bind port 0afc78c5-30fe-44b8-be25-b6544e0efa0e by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:16:13.851762 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Attempting to bind port 0afc78c5-30fe-44b8-be25-b6544e0efa0e on network 92ef9e7b-7c26-4986-b683-d2777b2485f6 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:16:13.867108 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Port 0afc78c5-30fe-44b8-be25-b6544e0efa0e on network 92ef9e7b-7c26-4986-b683-d2777b2485f6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:16:13.867435 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Attempting to bind port 0afc78c5-30fe-44b8-be25-b6544e0efa0e on network 92ef9e7b-7c26-4986-b683-d2777b2485f6 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:16:13.880168 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 15, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:16:13.880503 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Checking segment: {'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:16:13.880881 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Bound using segment: {'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:16:13.881307 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Bound port: 0afc78c5-30fe-44b8-be25-b6544e0efa0e, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '86bea8b1-4216-4683-8a95-512bc8c9bcac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 150, 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:16:13.881658 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:13.887456 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a9738d3f-4d6f-4961-a705-6f895cfc6db8 req-e39a839a-2dea-42f8-8518-20e38a565c2c tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747530 Nov 08 04:16:13.951885 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] For port 0afc78c5-30fe-44b8-be25-b6544e0efa0e, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:16:13.954916 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] For port 0afc78c5-30fe-44b8-be25-b6544e0efa0e, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:16:13.965092 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56390) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:13.977855 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-aaacf03e-53f0-4b97-8931-ce7496887471 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:14.026904 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:14.087432 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:14.087432 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:14.087432 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] 10.222.0.16 "PUT /v2.0/ports/0afc78c5-30fe-44b8-be25-b6544e0efa0e HTTP/1.1" status: 200 len: 1094 time: 0.8463714 Nov 08 04:16:14.088701 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:16:14.090958 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be2fa205-9268-4145-bec7-128540f43900" -d '{"events": [{"name": "network-changed", "server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:16:14.118151 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-aaacf03e-53f0-4b97-8931-ce7496887471 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:14.124623 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9999715b-bb10-41b3-99a7-f533423f277c service neutron] Pushing event updated for resources: {'Port': ['ID=0afc78c5-30fe-44b8-be25-b6544e0efa0e,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:14.137082 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:16:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6b4f8d9-41d3-40ff-a588-0489e738040f x-openstack-request-id: req-c6b4f8d9-41d3-40ff-a588-0489e738040f {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:16:14.137377 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:16:14.137629 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-c6b4f8d9-41d3-40ff-a588-0489e738040f {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:16:14.138030 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'status': 'completed', 'code': 200} Nov 08 04:16:14.185330 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-aaacf03e-53f0-4b97-8931-ce7496887471 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:14.250115 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-aaacf03e-53f0-4b97-8931-ce7496887471 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=1169483b8be34e88a4448afdf68e58fe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2815866 Nov 08 04:16:14.251045 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56394) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:14.263055 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaacf03e-53f0-4b97-8931-ce7496887471 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c8fe4279-cb3d-4ae2-964b-87b0fa5611ef,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:14.263055 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2fa205-9268-4145-bec7-128540f43900 req-1fdaed90-8168-417d-83f6-0775281a5aef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:14.263055 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be2fa205-9268-4145-bec7-128540f43900 req-1fdaed90-8168-417d-83f6-0775281a5aef service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d23a714c188845279fa19f9c87df4def&device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 1097 time: 0.0869112 Nov 08 04:16:14.302964 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-eefb7aa7-05a2-4159-9b27-f0aabeda3437 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:14.323704 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-eefb7aa7-05a2-4159-9b27-f0aabeda3437 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:14.380214 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2fa205-9268-4145-bec7-128540f43900 req-7b615bf4-fbce-4b4b-9466-53c45dc4358f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:14.382011 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be2fa205-9268-4145-bec7-128540f43900 req-7b615bf4-fbce-4b4b-9466-53c45dc4358f service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=d23a714c188845279fa19f9c87df4def&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1044977 Nov 08 04:16:14.450310 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-eefb7aa7-05a2-4159-9b27-f0aabeda3437 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:14.453558 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-eefb7aa7-05a2-4159-9b27-f0aabeda3437 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:14.454935 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-eefb7aa7-05a2-4159-9b27-f0aabeda3437 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/c8fe4279-cb3d-4ae2-964b-87b0fa5611ef HTTP/1.1" status: 204 len: 168 time: 0.2026556 Nov 08 04:16:14.464044 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eefb7aa7-05a2-4159-9b27-f0aabeda3437 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8fe4279-cb3d-4ae2-964b-87b0fa5611ef,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:14.486514 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2fa205-9268-4145-bec7-128540f43900 req-eda5da3f-6bdc-41e0-abfa-eb3bdb41bf89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:14.488574 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be2fa205-9268-4145-bec7-128540f43900 req-eda5da3f-6bdc-41e0-abfa-eb3bdb41bf89 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0974011 Nov 08 04:16:14.605970 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-ef6fd962-4d03-4178-a057-6bb1d6a69ae2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:14.607504 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-ef6fd962-4d03-4178-a057-6bb1d6a69ae2 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d23a714c188845279fa19f9c87df4def&device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 1097 time: 0.0468004 Nov 08 04:16:14.667319 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-9ed7b37c-5203-4d52-b111-43e07c2e59d2 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e HTTP/1.1" status: 200 len: 217 time: 0.0431135 Nov 08 04:16:14.717770 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-da0a1518-3769-4c14-ae78-afe56793ab62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:14.719403 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-da0a1518-3769-4c14-ae78-afe56793ab62 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=80d1402e-d73c-4668-9cb6-646683e6398f HTTP/1.1" status: 200 len: 854 time: 0.0439374 Nov 08 04:16:14.766064 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-61e98d75-0d6c-4070-91ab-a1b81549a039 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:14.767572 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-61e98d75-0d6c-4070-91ab-a1b81549a039 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=92ef9e7b-7c26-4986-b683-d2777b2485f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0394833 Nov 08 04:16:14.860416 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-4c315064-cd6a-44ac-a60d-60a3ca7675f7 service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842001 Nov 08 04:16:14.950532 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f007e51a-1c9b-4013-bf6a-d39d3c70e79e req-8a27f26b-63d9-4485-ac05-98dd45065f67 service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827086 Nov 08 04:16:15.084381 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56406) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:15.094797 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-95a981a1-e349-47fa-9945-df3991a9cb3c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:15.159574 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-dbe00f81-abf8-46b3-b5fd-42b89cab1342 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:15.167268 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-95a981a1-e349-47fa-9945-df3991a9cb3c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:15.170500 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0787454c-9a13-4467-84e7-77cba1e67679 req-26e3b348-1ca1-4b5d-acd0-584b5c229c87 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:15.170688 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0787454c-9a13-4467-84e7-77cba1e67679 req-26e3b348-1ca1-4b5d-acd0-584b5c229c87 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 944 time: 0.2120361 Nov 08 04:16:15.216746 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0787454c-9a13-4467-84e7-77cba1e67679 req-c8d20bb1-a35b-4840-b4c2-64689dc36b51 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403585 Nov 08 04:16:15.244612 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-95a981a1-e349-47fa-9945-df3991a9cb3c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:15.281633 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-95a981a1-e349-47fa-9945-df3991a9cb3c admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=bfe4d3d3079d433f87e728dae6d30975&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1987453 Nov 08 04:16:15.283567 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95a981a1-e349-47fa-9945-df3991a9cb3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a073a135-6da8-48a8-9903-6f41d0023f59,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:15.284272 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56408) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:15.339402 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-50472a46-878e-4c74-b902-85941cba1a10 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:15.359748 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-50472a46-878e-4c74-b902-85941cba1a10 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:15.461582 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-50472a46-878e-4c74-b902-85941cba1a10 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:15.464637 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-50472a46-878e-4c74-b902-85941cba1a10 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:15.465767 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-50472a46-878e-4c74-b902-85941cba1a10 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/a073a135-6da8-48a8-9903-6f41d0023f59 HTTP/1.1" status: 204 len: 168 time: 0.1804841 Nov 08 04:16:15.475160 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50472a46-878e-4c74-b902-85941cba1a10 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a073a135-6da8-48a8-9903-6f41d0023f59,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:15.897451 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f962d81-c5b4-4995-9710-63b1ed255ffc req-873d5049-52cd-426a-b87f-975c27d61ded tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:15.899092 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9f962d81-c5b4-4995-9710-63b1ed255ffc req-873d5049-52cd-426a-b87f-975c27d61ded tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 946 time: 0.0507834 Nov 08 04:16:15.953882 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9f962d81-c5b4-4995-9710-63b1ed255ffc req-4a0803d9-2294-4c86-99b9-8a3e3c679bf7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456758 Nov 08 04:16:15.959214 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:16.329597 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64323c7e-a1ee-48d9-9e51-b2b69299fcba req-eb7b1034-6c6a-43a7-a179-652a47b431a5 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:16.331056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-64323c7e-a1ee-48d9-9e51-b2b69299fcba req-eb7b1034-6c6a-43a7-a179-652a47b431a5 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 944 time: 0.0470185 Nov 08 04:16:16.378203 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-64323c7e-a1ee-48d9-9e51-b2b69299fcba req-c17a3512-7e4e-4a16-8814-691df00b4fa4 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406632 Nov 08 04:16:17.220567 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6c08e4-1a89-42b0-8138-e6a4b0c407bd req-6320a426-d15d-44d1-9deb-248aa9681368 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:17.222613 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aa6c08e4-1a89-42b0-8138-e6a4b0c407bd req-6320a426-d15d-44d1-9deb-248aa9681368 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 946 time: 0.1975245 Nov 08 04:16:17.268682 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aa6c08e4-1a89-42b0-8138-e6a4b0c407bd req-94b3824d-d72c-483f-b250-b7ceca3ab177 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402436 Nov 08 04:16:17.364407 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 0afc78c5-30fe-44b8-be25-b6544e0efa0e details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:16:17.463674 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 0afc78c5-30fe-44b8-be25-b6544e0efa0e, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:16:17.475551 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'port_id': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'mac_address': 'fa:16:3e:fc:32:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 150, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:16:17.505592 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b34c6c-47c4-46ae-a835-4798cbd434fe req-5de81507-1b7a-4054-8a80-f76208a62512 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:17.507128 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d8b34c6c-47c4-46ae-a835-4798cbd434fe req-5de81507-1b7a-4054-8a80-f76208a62512 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 944 time: 0.0531316 Nov 08 04:16:17.512636 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:17.536545 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0afc78c5-30fe-44b8-be25-b6544e0efa0e {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:16:17.558527 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 0afc78c5-30fe-44b8-be25-b6544e0efa0e, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:16:17.561413 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d8b34c6c-47c4-46ae-a835-4798cbd434fe req-7374d731-ca58-462f-8b21-bee186c4e12b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471671 Nov 08 04:16:17.610280 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:17.638236 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:17.685466 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=0afc78c5-30fe-44b8-be25-b6544e0efa0e,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:17.797067 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-2335c50c-a697-4375-a79a-4eaa7e3cd05f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:17.798493 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-2335c50c-a697-4375-a79a-4eaa7e3cd05f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.16 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 946 time: 0.0471227 Nov 08 04:16:17.903704 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Deleting port e6483e56-c377-4575-bd34-b26a5c2bf382 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:16:17.904068 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:17.971758 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:16:17.990630 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] For port e6483e56-c377-4575-bd34-b26a5c2bf382, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=e6483e56-c377-4575-bd34-b26a5c2bf382,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:16:17.990994 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:18.001028 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['0afc78c5-30fe-44b8-be25-b6544e0efa0e'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:16:18.287158 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:18.287738 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:18.287738 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Floating IP 52ece660-79a3-4c95-93a4-3b91caf2ffd7 disassociated. External IP: 172.27.2.56, port: e6483e56-c377-4575-bd34-b26a5c2bf382. Nov 08 04:16:18.288061 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Calling delete_port for e6483e56-c377-4575-bd34-b26a5c2bf382 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:16:18.376359 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:18.410695 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49c954b-d041-4802-af9a-67770a5bb72e req-77a75db1-0840-4267-a867-56a6fc1751fe tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:18.412650 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a49c954b-d041-4802-af9a-67770a5bb72e req-77a75db1-0840-4267-a867-56a6fc1751fe tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=dcc13a66-242b-4469-a2fd-7eefba428ffe HTTP/1.1" status: 200 len: 946 time: 0.0680325 Nov 08 04:16:18.490849 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a49c954b-d041-4802-af9a-67770a5bb72e req-32868b3c-42cf-4e3a-8b7b-69fe51c72648 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=5301efbc-e522-4603-b20e-2d3c40cd69c5&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0595188 Nov 08 04:16:18.540626 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:18.573992 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event deleted for resources: {'Port': ['ID=e6483e56-c377-4575-bd34-b26a5c2bf382,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:18.712040 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Router 02bab738-cfe2-4e4a-8864-2604a23990ee has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:16:18.719712 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f18795dc-7c10-4469-bd73-0908a8c0f198 req-0f368c9b-483c-4a63-8484-ee13194f36ec tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:18.721154 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f18795dc-7c10-4469-bd73-0908a8c0f198 req-0f368c9b-483c-4a63-8484-ee13194f36ec tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 945 time: 0.0894973 Nov 08 04:16:18.814447 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f18795dc-7c10-4469-bd73-0908a8c0f198 req-e5307106-c5c0-4125-bdb5-f4d47aefbafa tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864272 Nov 08 04:16:18.865609 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:16:18.876152 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] Sync routers for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:16:18.886329 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:16:18.886989 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:18.907341 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] No DVR routers for this DVR port e6483e56-c377-4575-bd34-b26a5c2bf382 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:16:18.910155 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:18.914262 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbcfb333-7226-4871-9b0a-ea28857dbe0d req-d52c05fb-37a5-4f69-8526-1cab6313ad3c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.16 "DELETE /v2.0/ports/e6483e56-c377-4575-bd34-b26a5c2bf382 HTTP/1.1" status: 204 len: 173 time: 1.1088846 Nov 08 04:16:18.914842 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'name': 'network-vif-deleted', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:16:18.917322 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9400d06e-c582-4ee2-8b21-9cae432f20cc" -d '{"events": [{"server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "name": "network-vif-deleted", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:16:18.955705 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:16:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d1e1ef5-9a2d-4502-b369-8890ab2452b5 x-openstack-request-id: req-2d1e1ef5-9a2d-4502-b369-8890ab2452b5 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:16:18.956000 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dcc13a66-242b-4469-a2fd-7eefba428ffe", "name": "network-vif-deleted", "tag": "e6483e56-c377-4575-bd34-b26a5c2bf382", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:16:18.956253 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-2d1e1ef5-9a2d-4502-b369-8890ab2452b5 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:16:18.956680 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dcc13a66-242b-4469-a2fd-7eefba428ffe', 'name': 'network-vif-deleted', 'tag': 'e6483e56-c377-4575-bd34-b26a5c2bf382', 'status': 'completed', 'code': 200} Nov 08 04:16:18.995452 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:16:19.198534 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:19.224808 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] Checking router: 02bab738-cfe2-4e4a-8864-2604a23990ee for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:16:19.233588 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:16:19.234065 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:19.340372 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:16:19.413705 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 0afc78c5-30fe-44b8-be25-b6544e0efa0e up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:16:19.584534 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:19.613956 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d6d5303-8e57-4cb0-95d2-45c03ad985c9 None None] The sync data for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi is: [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:16:19.620717 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 0afc78c5-30fe-44b8-be25-b6544e0efa0e completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:16:19.624871 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 0afc78c5-30fe-44b8-be25-b6544e0efa0e triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:16:19.625460 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:19.685818 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56518) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:19.714330 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:19.738548 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:16:19.740777 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-76c7d2bf-f225-4411-a2f4-67bcd9667dd1" -d '{"events": [{"server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "name": "network-vif-plugged", "status": "completed", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:16:19.750692 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ba815284-b1e2-4df5-ab4d-2763f47185e9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:19.757478 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 0afc78c5-30fe-44b8-be25-b6544e0efa0e, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:16:19.781440 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ba815284-b1e2-4df5-ab4d-2763f47185e9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:19.785012 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:16:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0eac2f3-f0f7-4e8f-9097-05abba423cd5 x-openstack-request-id: req-b0eac2f3-f0f7-4e8f-9097-05abba423cd5 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:16:19.785342 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "name": "network-vif-plugged", "status": "completed", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:16:19.785594 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-b0eac2f3-f0f7-4e8f-9097-05abba423cd5 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:16:19.786111 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'code': 200} Nov 08 04:16:19.833632 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:19.834985 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device e6483e56-c377-4575-bd34-b26a5c2bf382 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:16:19.875441 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: e6483e56-c377-4575-bd34-b26a5c2bf382 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:16:19.875977 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device e6483e56-c377-4575-bd34-b26a5c2bf382 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:16:19.914408 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ba815284-b1e2-4df5-ab4d-2763f47185e9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:19.917355 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ba815284-b1e2-4df5-ab4d-2763f47185e9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:19.921580 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56524) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:19.930983 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ba815284-b1e2-4df5-ab4d-2763f47185e9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "DELETE /v2.0/security-groups/5301efbc-e522-4603-b20e-2d3c40cd69c5 HTTP/1.1" status: 204 len: 168 time: 0.2440417 Nov 08 04:16:19.942231 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.api.v2.resource [None req-95fd8b49-2061-49ee-9ddc-a6e4dda83324 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] show failed (client error): The resource could not be found. Nov 08 04:16:19.949292 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-95fd8b49-2061-49ee-9ddc-a6e4dda83324 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups/5301efbc-e522-4603-b20e-2d3c40cd69c5 HTTP/1.1" status: 404 len: 347 time: 0.0260704 Nov 08 04:16:19.953435 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=0afc78c5-30fe-44b8-be25-b6544e0efa0e,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:19.953964 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56526) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:19.975458 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba815284-b1e2-4df5-ab4d-2763f47185e9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5301efbc-e522-4603-b20e-2d3c40cd69c5,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:19.975747 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1da10657-a72f-475b-b960-3e42fba8036d None None] New status for floating IP 52ece660-79a3-4c95-93a4-3b91caf2ffd7: DOWN {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:16:20.005038 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d17fdd1-6ee8-45af-896b-2f41d1a9c7e5 req-597ab659-c0b1-42b9-b05f-7b0f456acad4 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:20.015550 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1d17fdd1-6ee8-45af-896b-2f41d1a9c7e5 req-597ab659-c0b1-42b9-b05f-7b0f456acad4 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.1163213 Nov 08 04:16:20.084439 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1d17fdd1-6ee8-45af-896b-2f41d1a9c7e5 req-761fd3ef-fdc5-4e8f-b56c-e8b033dbd1d5 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676715 Nov 08 04:16:20.109349 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-a046d865-690c-499f-a7e4-07cdfdb6e7c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Deleting port 612109a2-fe18-4eb8-8e67-0167cc19f3eb {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:16:20.109909 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a046d865-690c-499f-a7e4-07cdfdb6e7c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:20.196846 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a046d865-690c-499f-a7e4-07cdfdb6e7c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:20.197213 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a046d865-690c-499f-a7e4-07cdfdb6e7c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:20.210749 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-a046d865-690c-499f-a7e4-07cdfdb6e7c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Calling delete_port for 612109a2-fe18-4eb8-8e67-0167cc19f3eb owned by network:floatingip {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:16:20.243460 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd95f4b-3ecc-436a-ba02-9ca2c4a0ff9c req-fcd91c3b-b5b4-4bae-9cb1-50703cb290a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:20.244920 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dcd95f4b-3ecc-436a-ba02-9ca2c4a0ff9c req-fcd91c3b-b5b4-4bae-9cb1-50703cb290a4 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 1099 time: 0.0432885 Nov 08 04:16:20.289909 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dcd95f4b-3ecc-436a-ba02-9ca2c4a0ff9c req-bf9fd527-54fc-4d2d-a5de-cc76ba9de59d service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373843 Nov 08 04:16:20.564856 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a046d865-690c-499f-a7e4-07cdfdb6e7c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:20.590864 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a046d865-690c-499f-a7e4-07cdfdb6e7c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event deleted for resources: {'Port': ['ID=612109a2-fe18-4eb8-8e67-0167cc19f3eb,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:20.662208 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a046d865-690c-499f-a7e4-07cdfdb6e7c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:20.665056 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a046d865-690c-499f-a7e4-07cdfdb6e7c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:20.666992 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a046d865-690c-499f-a7e4-07cdfdb6e7c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "DELETE /v2.0/floatingips/52ece660-79a3-4c95-93a4-3b91caf2ffd7 HTTP/1.1" status: 204 len: 168 time: 0.7118025 Nov 08 04:16:21.026903 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56536) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:21.031502 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-e0ee8582-8e62-49a3-ab54-35f0c1223163 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1796506813', 'description': 'tempest-description--1634919219'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:21.124322 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-e0ee8582-8e62-49a3-ab54-35f0c1223163 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.235772 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ab1289-5684-442d-a993-f1a66c248d3a req-6f6f3298-f71c-4950-a078-83905a5ff94a tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:21.237249 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02ab1289-5684-442d-a993-f1a66c248d3a req-6f6f3298-f71c-4950-a078-83905a5ff94a tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.0845072 Nov 08 04:16:21.239604 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-e0ee8582-8e62-49a3-ab54-35f0c1223163 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.284714 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02ab1289-5684-442d-a993-f1a66c248d3a req-1ee04c53-334e-4952-bdfd-1c8a6cc4a57a tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412781 Nov 08 04:16:21.307041 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-e0ee8582-8e62-49a3-ab54-35f0c1223163 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.341930 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ee8582-8e62-49a3-ab54-35f0c1223163 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'SecurityGroup': ['ID=000cac17-c1e8-4274-86fc-7bc010b0203c,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:21.412039 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-e0ee8582-8e62-49a3-ab54-35f0c1223163 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.413279 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-e0ee8582-8e62-49a3-ab54-35f0c1223163 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.3853691 Nov 08 04:16:21.416228 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56540) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:21.420830 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-d4c0de69-b308-4eba-8bb7-7fb270ed801d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'security_group_rule': {'security_group_id': '000cac17-c1e8-4274-86fc-7bc010b0203c', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:21.506316 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d4c0de69-b308-4eba-8bb7-7fb270ed801d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.561536 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d4c0de69-b308-4eba-8bb7-7fb270ed801d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.661948 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d4c0de69-b308-4eba-8bb7-7fb270ed801d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.683566 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4c0de69-b308-4eba-8bb7-7fb270ed801d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5e3faa4e-50e2-4049-a7e8-709dfc529299,revision_number=0']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:21.737728 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d4c0de69-b308-4eba-8bb7-7fb270ed801d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.739612 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-d4c0de69-b308-4eba-8bb7-7fb270ed801d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3223968 Nov 08 04:16:21.745057 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56544) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:21.749563 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-9f983757-4dbd-4e97-9bbf-6682d846ae7e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'security_group_rule': {'security_group_id': '000cac17-c1e8-4274-86fc-7bc010b0203c', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:21.832164 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9f983757-4dbd-4e97-9bbf-6682d846ae7e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.886026 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9f983757-4dbd-4e97-9bbf-6682d846ae7e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.970173 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9f983757-4dbd-4e97-9bbf-6682d846ae7e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:21.993159 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f983757-4dbd-4e97-9bbf-6682d846ae7e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0194da29-2dad-47d9-b6cb-e83e2fae4185,revision_number=0']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:22.052354 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9f983757-4dbd-4e97-9bbf-6682d846ae7e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:22.053543 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-9f983757-4dbd-4e97-9bbf-6682d846ae7e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3075213 Nov 08 04:16:22.056673 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56546) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:22.061101 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'floatingip': {'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:22.136180 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:22.228375 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:22.339385 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Allocated IP 172.27.2.79 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/e49affde-69ab-4721-9db6-92cd48161273) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:16:22.460016 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9097ea68-068e-477c-8811-92c67d6065a4 req-ea898f95-8296-4bd8-90bf-6be0fb31e1e8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:22.461419 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9097ea68-068e-477c-8811-92c67d6065a4 req-ea898f95-8296-4bd8-90bf-6be0fb31e1e8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.1056104 Nov 08 04:16:22.486714 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:22.537638 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9097ea68-068e-477c-8811-92c67d6065a4 req-0b03e598-d287-4218-9c23-b7564eda82f0 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686996 Nov 08 04:16:22.592730 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:22.636595 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:16:22.652174 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:16:22.668677 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:16:22.672201 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'Port': ['ID=e49affde-69ab-4721-9db6-92cd48161273,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:22.729193 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2913b9e5-bade-4d4d-b832-e27d40989c45 req-d6395ee3-531e-4127-b9c0-54f0d9c521e3 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:22.730584 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2913b9e5-bade-4d4d-b832-e27d40989c45 req-d6395ee3-531e-4127-b9c0-54f0d9c521e3 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.1010480 Nov 08 04:16:22.806204 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:22.814857 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2913b9e5-bade-4d4d-b832-e27d40989c45 req-a0eead25-55a7-4ee8-af3d-60a68edc751d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780153 Nov 08 04:16:22.886860 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:23.053529 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:23.103466 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:23.205098 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f7a02b-dced-466a-8ebe-23ec592c1823 req-76e5bcae-8e85-41fe-966c-143171c5c5d5 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:23.206567 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-73f7a02b-dced-466a-8ebe-23ec592c1823 req-76e5bcae-8e85-41fe-966c-143171c5c5d5 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.1143970 Nov 08 04:16:23.207181 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'Port': ['ID=e49affde-69ab-4721-9db6-92cd48161273,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:23.215357 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:23.271658 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-73f7a02b-dced-466a-8ebe-23ec592c1823 req-ddfdc301-252a-44ff-8f3c-49ab0074a1e5 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580056 Nov 08 04:16:23.343415 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:23.344657 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-6acd97e1-7dad-4634-a0c9-2c1293c8d486 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.2869778 Nov 08 04:16:23.538061 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-e8454fc6-dc81-47ca-99eb-29a854d1132b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?name=tempest-securitygroup--1796506813&fields=id&tenant_id=0efb8c7b359746668b199d14191e3f09 HTTP/1.1" status: 200 len: 267 time: 0.0407696 Nov 08 04:16:23.652438 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a3986162-137a-4028-9aa7-b181d1eeaf70 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:23.653884 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a3986162-137a-4028-9aa7-b181d1eeaf70 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 817 time: 0.1090219 Nov 08 04:16:23.669357 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-1c6afbaf-c150-45fe-b6fe-cc6c63be00a5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/quotas/0efb8c7b359746668b199d14191e3f09 HTTP/1.1" status: 200 len: 375 time: 0.0096543 Nov 08 04:16:23.972535 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9f77406-c6ff-4417-8c13-594600fdb440 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2974396 Nov 08 04:16:24.112238 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-22aff628-e9c8-492f-b2f1-d6510947f6ba service neutron] 10.222.0.21 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1236362 Nov 08 04:16:24.196609 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-d291c633-fe96-48d5-b331-d1bb0a3a38a4 service neutron] 10.222.0.21 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822814 Nov 08 04:16:24.238682 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:24.451200 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c296533-fbaa-471f-90cd-39c4d53c1cab req-e24ccd5c-71aa-4db8-b79e-8c789c5fe9b1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 210 time: 0.0267835 Nov 08 04:16:25.547719 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ba1febff-94cc-47e7-ad9f-59a28f5343e6 req-9993ac6b-1e5b-4ed6-b74b-a88a93e873ea tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 210 time: 0.0249434 Nov 08 04:16:25.685597 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-c1176eb0-e00f-4dae-8f4d-3f204fdf4fec service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0420597 Nov 08 04:16:25.766755 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-6d8ca7fd-c57e-429f-b792-d3ac9715f4df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:25.768534 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-6d8ca7fd-c57e-429f-b792-d3ac9715f4df service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 1098 time: 0.0428171 Nov 08 04:16:25.872354 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-e397eb25-d040-4d45-ab6d-9035eaa02d80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:25.873775 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-e397eb25-d040-4d45-ab6d-9035eaa02d80 service neutron] 10.222.0.16 "GET /v2.0/networks?id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f HTTP/1.1" status: 200 len: 912 time: 0.0827248 Nov 08 04:16:25.962670 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-19a707a8-6f3b-4d0f-b31b-378f25870b77 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d997f4bb-f698-4538-b9ae-f08bec1d6ff6 HTTP/1.1" status: 200 len: 1000 time: 0.0781391 Nov 08 04:16:26.015347 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-362c42d9-25e3-46c9-872e-f7a3280da5fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:26.016722 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-362c42d9-25e3-46c9-872e-f7a3280da5fc service neutron] 10.222.0.16 "GET /v2.0/subnets?id=1158e941-c129-49d0-9b8b-ba72d0ef6717 HTTP/1.1" status: 200 len: 850 time: 0.0445061 Nov 08 04:16:26.073906 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-5cce9154-3821-485c-a5d5-1bd3b621c6e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:26.076379 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-5cce9154-3821-485c-a5d5-1bd3b621c6e6 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418053 Nov 08 04:16:26.182120 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-90e775cd-c9c3-45fe-9872-a556c3bbceda service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849478 Nov 08 04:16:26.272352 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce9e5dd1-bf31-4608-89a1-870609ad20e5 req-3c951c38-5a85-4aec-b271-2d606b427e77 service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820911 Nov 08 04:16:26.654067 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8f6a3e9e-7882-4842-aad9-a2cab08a78a8 req-c54f0d25-b0a9-45a5-b53f-58367e25ee26 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 210 time: 0.0341957 Nov 08 04:16:26.743954 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-1d57b308-6bf9-4eb8-a7d6-9fb2409efdf7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:26.745356 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-1d57b308-6bf9-4eb8-a7d6-9fb2409efdf7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 817 time: 0.1012862 Nov 08 04:16:26.823731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-92c04baf-b22d-46ed-af99-d97db93d124c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0efb8c7b359746668b199d14191e3f09 HTTP/1.1" status: 200 len: 380 time: 0.0562181 Nov 08 04:16:26.832200 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'port': {'device_id': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'admin_state_up': True, 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'security_groups': ['000cac17-c1e8-4274-86fc-7bc010b0203c']}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:27.004424 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Made reservation on behalf of 0efb8c7b359746668b199d14191e3f09 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:16:27.014218 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:27.152670 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Allocated IP 172.20.0.10 (6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e/20a91346-16ed-4174-9e29-b85a8dc77939/d29d5bf6-7687-47ca-9dbc-9c6db81cd605) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:16:27.286602 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:27.365344 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:27.406635 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:16:27.412320 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:16:27.416583 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:16:27.423670 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event updated for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:27.471419 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:27.472034 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:27.560431 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-9de89430-bf19-4f02-959e-9db1c1dcad36 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7326806 Nov 08 04:16:27.590016 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Request body: {'port': {'device_id': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:27.645402 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:27.688749 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-bbefef03-85b3-4737-9223-d0cde7393f4b None None] Provisioning complete for port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:16:27.689423 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bbefef03-85b3-4737-9223-d0cde7393f4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:27.729345 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-bbefef03-85b3-4737-9223-d0cde7393f4b None None] Port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:16:27.846801 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a98679-0bd2-4516-a405-edaa41b1ce3b req-801633eb-c8ed-47ef-8504-6d86a6796bba tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:27.848277 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-04a98679-0bd2-4516-a405-edaa41b1ce3b req-801633eb-c8ed-47ef-8504-6d86a6796bba tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 932 time: 0.1063423 Nov 08 04:16:27.924327 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-04a98679-0bd2-4516-a405-edaa41b1ce3b req-82ef7593-fbac-4e54-baf1-3333e3620a71 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0645742 Nov 08 04:16:27.974765 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d29d5bf6-7687-47ca-9dbc-9c6db81cd605 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:16:27.981983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:27.994335 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Transition to ACTIVE for port object d29d5bf6-7687-47ca-9dbc-9c6db81cd605 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:16:28.078712 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:28.131070 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Pushing event updated for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:28.200315 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Attempting to bind port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:16:28.200646 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Attempting to bind port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:16:28.200972 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Attempting to bind port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 on network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:16:28.205455 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 on network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:16:28.205803 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Attempting to bind port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 on network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:16:28.211266 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 16, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:16:28.211649 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Checking segment: {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:16:28.211967 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Bound using segment: {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:16:28.212419 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Bound port: d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c233b592-8fd7-4c2a-b811-110d9b226d31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 184, 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:16:28.212773 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:28.283916 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:16:28.287395 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:16:28.359462 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:28.388744 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:28.389558 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:28.391048 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] 10.222.0.16 "PUT /v2.0/ports/d29d5bf6-7687-47ca-9dbc-9c6db81cd605 HTTP/1.1" status: 200 len: 1094 time: 0.8053861 Nov 08 04:16:28.393423 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:16:28.395950 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-32c375a5-5d32-4a37-8086-fbe4046aa875" -d '{"events": [{"name": "network-changed", "server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:16:28.427826 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d7163d-96b9-4069-933a-50d0c4d85f01 service neutron] Pushing event updated for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:28.437721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:16:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96b12799-85fa-40ea-95bb-9537ad481198 x-openstack-request-id: req-96b12799-85fa-40ea-95bb-9537ad481198 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:16:28.438017 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:16:28.438270 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-96b12799-85fa-40ea-95bb-9537ad481198 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:16:28.438746 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'status': 'completed', 'code': 200} Nov 08 04:16:28.547623 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c375a5-5d32-4a37-8086-fbe4046aa875 req-3831ce30-341c-47c0-a05c-ddb3566182a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:28.549130 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32c375a5-5d32-4a37-8086-fbe4046aa875 req-3831ce30-341c-47c0-a05c-ddb3566182a7 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 1097 time: 0.0429995 Nov 08 04:16:28.662950 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c375a5-5d32-4a37-8086-fbe4046aa875 req-7175ca14-6d52-47c5-88e2-0392645fcbf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:28.664326 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32c375a5-5d32-4a37-8086-fbe4046aa875 req-7175ca14-6d52-47c5-88e2-0392645fcbf6 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=0efb8c7b359746668b199d14191e3f09&shared=False HTTP/1.1" status: 200 len: 918 time: 0.0929928 Nov 08 04:16:28.758619 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c375a5-5d32-4a37-8086-fbe4046aa875 req-0d90c321-7ca7-4a60-aac6-6e00187e56cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:28.759979 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32c375a5-5d32-4a37-8086-fbe4046aa875 req-0d90c321-7ca7-4a60-aac6-6e00187e56cc service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0862138 Nov 08 04:16:28.881944 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-3c9c82a4-4947-4bf3-902e-5cac577ef024 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:28.883436 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-3c9c82a4-4947-4bf3-902e-5cac577ef024 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 1097 time: 0.0424933 Nov 08 04:16:28.935443 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-12eb9ded-5d02-4b03-9f45-37f25bedf541 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605 HTTP/1.1" status: 200 len: 217 time: 0.0370386 Nov 08 04:16:28.983936 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-1ddf5c61-e412-487a-9617-e5ca4dca3d6d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:28.985439 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-1ddf5c61-e412-487a-9617-e5ca4dca3d6d service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.0422018 Nov 08 04:16:29.032232 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-3a85b965-3a13-4bea-ba81-c7deae341b00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:29.033724 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-3a85b965-3a13-4bea-ba81-c7deae341b00 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0408759 Nov 08 04:16:29.159468 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017c3838-d909-48eb-ae41-7773bb390e5a req-575644d4-82a8-4249-91a3-3b8383fbc5c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:29.161452 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-017c3838-d909-48eb-ae41-7773bb390e5a req-575644d4-82a8-4249-91a3-3b8383fbc5c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.1007547 Nov 08 04:16:29.166775 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-019d8b47-b961-41cf-aaff-d15d5c75e658 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237113 Nov 08 04:16:29.262686 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-017c3838-d909-48eb-ae41-7773bb390e5a req-2c484ab6-518e-4678-83a8-6e03ec3cdd60 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0948617 Nov 08 04:16:29.288657 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65ad0586-933b-47ba-a9f3-8b7a40b89ba7 req-d64464b6-9f26-4b0d-8e9b-e823b537a8a6 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1080101 Nov 08 04:16:30.383389 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080ee1fd-cacc-4b5c-b4d1-e94717ca7231 req-2cd36d1c-d30c-4c60-a6f4-4d01cdae8323 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:30.384843 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-080ee1fd-cacc-4b5c-b4d1-e94717ca7231 req-2cd36d1c-d30c-4c60-a6f4-4d01cdae8323 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0486739 Nov 08 04:16:30.429250 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-080ee1fd-cacc-4b5c-b4d1-e94717ca7231 req-a58e0e22-f005-4b83-83b4-b2ca9d68c288 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386415 Nov 08 04:16:31.408339 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d29d5bf6-7687-47ca-9dbc-9c6db81cd605 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:16:31.502525 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:16:31.513785 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'port_id': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'mac_address': 'fa:16:3e:70:81:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 184, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:16:31.556039 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20435dc2-8947-49cf-88b6-74ac4dcdc755 req-6c3b0a3f-6dc0-4a8a-9a2c-838722c4840f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:31.557836 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-20435dc2-8947-49cf-88b6-74ac4dcdc755 req-6c3b0a3f-6dc0-4a8a-9a2c-838722c4840f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0533834 Nov 08 04:16:31.609922 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-20435dc2-8947-49cf-88b6-74ac4dcdc755 req-b0df6404-7949-4812-b91b-f39c4bd8565a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459831 Nov 08 04:16:31.670211 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:31.683209 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d29d5bf6-7687-47ca-9dbc-9c6db81cd605 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:16:31.701999 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:16:31.770057 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:31.815441 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:32.170234 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['d29d5bf6-7687-47ca-9dbc-9c6db81cd605'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:16:32.731696 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1ea380-a7a0-4977-8c7c-710fa1a15b97 req-4bcd3d0c-bb7c-4057-80c8-1eba446e4142 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:32.733159 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4a1ea380-a7a0-4977-8c7c-710fa1a15b97 req-4bcd3d0c-bb7c-4057-80c8-1eba446e4142 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 945 time: 0.0480428 Nov 08 04:16:32.783830 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4a1ea380-a7a0-4977-8c7c-710fa1a15b97 req-a81c6d47-3e4e-4db9-b66d-b0ae087bab79 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437658 Nov 08 04:16:33.411990 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d29d5bf6-7687-47ca-9dbc-9c6db81cd605 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:16:33.513158 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:16:33.517106 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:16:33.517711 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:33.594542 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:33.616543 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:16:33.618735 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6663535-8dba-402c-9cec-de7dca9b205a" -d '{"events": [{"server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "name": "network-vif-plugged", "status": "completed", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:16:33.630688 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:16:33.653423 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:16:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8af0dcaa-d492-4baa-a946-cd788d1435d8 x-openstack-request-id: req-8af0dcaa-d492-4baa-a946-cd788d1435d8 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:16:33.653710 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "name": "network-vif-plugged", "status": "completed", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:16:33.653960 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-8af0dcaa-d492-4baa-a946-cd788d1435d8 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:16:33.654371 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'code': 200} Nov 08 04:16:33.695487 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:33.741093 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:33.901279 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ff6f50b-7797-4eff-a554-6b503f6cba3c req-89f6bb29-d7e2-437f-9dda-c5556bc53347 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:33.902727 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3ff6f50b-7797-4eff-a554-6b503f6cba3c req-89f6bb29-d7e2-437f-9dda-c5556bc53347 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0479248 Nov 08 04:16:33.953567 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3ff6f50b-7797-4eff-a554-6b503f6cba3c req-4f595545-ac00-4c03-a541-b08e43704f41 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447316 Nov 08 04:16:34.054389 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95649b16-d224-4281-8d65-2be1871edeb6 req-e4368663-f488-4515-8275-1a0b3ddff7df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:34.055857 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-95649b16-d224-4281-8d65-2be1871edeb6 req-e4368663-f488-4515-8275-1a0b3ddff7df service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 1099 time: 0.0814526 Nov 08 04:16:34.099801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-95649b16-d224-4281-8d65-2be1871edeb6 req-6a3c83ae-77cf-4cb4-8404-f0fc6c34fc43 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359995 Nov 08 04:16:34.543270 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d65c39a-cdd2-4518-8952-9e6b941b678c req-bfc9d312-3da6-45cd-a37d-d100be848184 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:34.544715 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0d65c39a-cdd2-4518-8952-9e6b941b678c req-bfc9d312-3da6-45cd-a37d-d100be848184 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.0481920 Nov 08 04:16:34.590729 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0d65c39a-cdd2-4518-8952-9e6b941b678c req-d4f23aaa-0b9e-4f7a-8bec-921a1560f852 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400391 Nov 08 04:16:34.612351 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56700) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:34.749379 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b281c2e5-c005-4a72-baaf-e84f03cc7057 tempest-TestMinimumBasicScenario-2096064481 tempest-TestMinimumBasicScenario-2096064481-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:34.750902 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-b281c2e5-c005-4a72-baaf-e84f03cc7057 tempest-TestMinimumBasicScenario-2096064481 tempest-TestMinimumBasicScenario-2096064481-project-admin] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 1094 time: 0.1375816 Nov 08 04:16:34.753661 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56704) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:34.758338 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'floatingip': {'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'port_id': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'fixed_ip_address': '172.20.0.10'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:34.860217 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for floatingip, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:34.951717 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:35.058535 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Allocated IP 172.27.2.145 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/f8ffd04d-cec6-41eb-9fcf-c89cd8d0ef22) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:16:35.076027 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e109f342-cdf3-44e7-b46c-86fd000a60a8 req-b3ac5d82-e5fa-4d8c-8cbf-4f0d04f7e93f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:35.077512 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e109f342-cdf3-44e7-b46c-86fd000a60a8 req-b3ac5d82-e5fa-4d8c-8cbf-4f0d04f7e93f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0523446 Nov 08 04:16:35.124621 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e109f342-cdf3-44e7-b46c-86fd000a60a8 req-2aafd079-ba1a-45db-b0b1-561220ae9ba4 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410376 Nov 08 04:16:35.155675 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:35.221894 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:35.261844 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:16:35.266413 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:16:35.269866 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:16:35.290718 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'Port': ['ID=f8ffd04d-cec6-41eb-9fcf-c89cd8d0ef22,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:35.301189 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.301533 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.301870 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.302204 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.302556 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.303529 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.303853 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.304179 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.304503 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.304824 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.305143 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.305460 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:35.865185 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:35.976676 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:36.128241 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:36.187036 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:36.252575 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f61785-b028-4737-8bf1-d035eb865ce6 req-c4ce3380-b8c2-463c-b186-072157d9554d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:36.254079 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02f61785-b028-4737-8bf1-d035eb865ce6 req-c4ce3380-b8c2-463c-b186-072157d9554d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0590019 Nov 08 04:16:36.259551 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'Port': ['ID=f8ffd04d-cec6-41eb-9fcf-c89cd8d0ef22,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:36.267828 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:36.300767 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02f61785-b028-4737-8bf1-d035eb865ce6 req-a5aa4f82-5712-467e-ab9e-e33486d4d967 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406365 Nov 08 04:16:36.367811 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.l3_db [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Floating IP f3567171-f979-4f22-a34b-d1df1a856cd8 associated. External IP: 172.27.2.145, port: 0afc78c5-30fe-44b8-be25-b6544e0efa0e. Nov 08 04:16:36.415779 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fbcff6-c720-47d3-bd90-c000ca1a7120 req-8ab43029-f6f0-46f5-aa98-66120b07cd9d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:36.417256 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-54fbcff6-c720-47d3-bd90-c000ca1a7120 req-8ab43029-f6f0-46f5-aa98-66120b07cd9d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0483553 Nov 08 04:16:36.426019 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56716) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:36.430642 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-2131ec27-221b-4b25-a217-d7e166a99244 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Request body: {'floatingip': {'port_id': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:36.476489 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2131ec27-221b-4b25-a217-d7e166a99244 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:36.585129 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Router b957ebf8-7cce-4f10-a834-1069f67f87ec has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:16:36.697353 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:16:36.707548 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] Sync routers for ids ['b957ebf8-7cce-4f10-a834-1069f67f87ec'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:16:36.718671 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] Routers {'b957ebf8-7cce-4f10-a834-1069f67f87ec'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:16:36.719377 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b957ebf8-7cce-4f10-a834-1069f67f87ec'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:36.795493 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:36.826745 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] Set router b957ebf8-7cce-4f10-a834-1069f67f87ec gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:16:36.827732 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-3a3b8c29-e345-46b0-b555-740c29a135a2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.0730760 Nov 08 04:16:36.829136 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:16:36.830696 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4fc2f92-a088-447c-af35-4d6356f95c25" -d '{"events": [{"name": "network-changed", "server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:16:36.831123 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56718) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:36.836326 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-d1d46c7d-ce37-4683-80d6-4a280c77e0f9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-920049864', 'description': 'tempest-secgroup-smoke-920049864 description', 'project_id': 'd23a714c188845279fa19f9c87df4def'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:36.869355 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:16:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-315cd611-f8de-4cfc-a0a9-2a6e640c2591 x-openstack-request-id: req-315cd611-f8de-4cfc-a0a9-2a6e640c2591 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:16:36.869355 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:16:36.869355 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-315cd611-f8de-4cfc-a0a9-2a6e640c2591 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:16:36.869355 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'status': 'completed', 'code': 200} Nov 08 04:16:36.953555 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d1d46c7d-ce37-4683-80d6-4a280c77e0f9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:36.974336 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2131ec27-221b-4b25-a217-d7e166a99244 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:36.992573 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-5f1069cf-e608-43f2-8b09-25f8966c009e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:36.994070 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-5f1069cf-e608-43f2-8b09-25f8966c009e service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d23a714c188845279fa19f9c87df4def&device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 1099 time: 0.0749032 Nov 08 04:16:37.039714 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2131ec27-221b-4b25-a217-d7e166a99244 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.054989 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': 'f3567171-f979-4f22-a34b-d1df1a856cd8', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'floating_ip_address': '172.27.2.145', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'port_id': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 497, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'mac_address': 'fa:16:3e:fc:32:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cf104fc-d344-4175-ab31-20087fd691b4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:16:35Z', 'updated_at': '2021-11-08T04:16:35Z', 'revision_number': 0, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8d2bcad-96e3-44ea-b4e9-0ae6561bb929', 'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'mac_address': 'fa:16:3e:19:26:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:31Z', 'updated_at': '2021-11-08T04:15:35Z', 'revision_number': 5, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'subnets': [{'id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:37.081005 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] Checking router: b957ebf8-7cce-4f10-a834-1069f67f87ec for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:16:37.089095 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] Routers {'b957ebf8-7cce-4f10-a834-1069f67f87ec'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:16:37.089698 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b957ebf8-7cce-4f10-a834-1069f67f87ec'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:37.135659 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d1d46c7d-ce37-4683-80d6-4a280c77e0f9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.188916 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d1d46c7d-ce37-4683-80d6-4a280c77e0f9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.193164 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] Set router b957ebf8-7cce-4f10-a834-1069f67f87ec gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:16:37.211513 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-7dbd58e8-c329-44c3-a889-f2bb211604f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:37.212872 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-7dbd58e8-c329-44c3-a889-f2bb211604f6 service neutron] 10.222.0.16 "GET /v2.0/networks?id=92ef9e7b-7c26-4986-b683-d2777b2485f6 HTTP/1.1" status: 200 len: 916 time: 0.2088790 Nov 08 04:16:37.269604 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [None req-2131ec27-221b-4b25-a217-d7e166a99244 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Floating IP d5923b86-b8b4-4333-af31-335a334d46b9 associated. External IP: 172.27.2.79, port: d29d5bf6-7687-47ca-9dbc-9c6db81cd605. Nov 08 04:16:37.276513 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d46c7d-ce37-4683-80d6-4a280c77e0f9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:37.321527 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d1d46c7d-ce37-4683-80d6-4a280c77e0f9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.322895 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-d1d46c7d-ce37-4683-80d6-4a280c77e0f9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.4907179 Nov 08 04:16:37.326965 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56726) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:37.333376 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-254050f0-976c-41f8-869d-d567d3e0a0bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'security_group_rule': {'security_group_id': '5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0', 'project_id': 'd23a714c188845279fa19f9c87df4def', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:37.427346 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-254050f0-976c-41f8-869d-d567d3e0a0bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.449429 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': 'f3567171-f979-4f22-a34b-d1df1a856cd8', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'floating_ip_address': '172.27.2.145', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'port_id': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 497, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'mac_address': 'fa:16:3e:fc:32:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cf104fc-d344-4175-ab31-20087fd691b4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:16:35Z', 'updated_at': '2021-11-08T04:16:35Z', 'revision_number': 0, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8d2bcad-96e3-44ea-b4e9-0ae6561bb929', 'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'mac_address': 'fa:16:3e:19:26:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:31Z', 'updated_at': '2021-11-08T04:15:35Z', 'revision_number': 5, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'subnets': [{'id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:37.485461 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0aed394f-d329-4c18-88f7-cdea907dfd13 None None] The sync data for ids ['b957ebf8-7cce-4f10-a834-1069f67f87ec'] in dv-cinder-783643-4-iscsi is: [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': 'f3567171-f979-4f22-a34b-d1df1a856cd8', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'floating_ip_address': '172.27.2.145', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'port_id': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 497, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'mac_address': 'fa:16:3e:fc:32:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cf104fc-d344-4175-ab31-20087fd691b4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:16:35Z', 'updated_at': '2021-11-08T04:16:35Z', 'revision_number': 0, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8d2bcad-96e3-44ea-b4e9-0ae6561bb929', 'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'mac_address': 'fa:16:3e:19:26:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:31Z', 'updated_at': '2021-11-08T04:15:35Z', 'revision_number': 5, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'subnets': [{'id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:16:37.506794 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-254050f0-976c-41f8-869d-d567d3e0a0bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.607364 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-51e45698-54ea-4dde-9da3-e236444c4ede service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e HTTP/1.1" status: 200 len: 1000 time: 0.3867009 Nov 08 04:16:37.633158 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-254050f0-976c-41f8-869d-d567d3e0a0bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.655774 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-254050f0-976c-41f8-869d-d567d3e0a0bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=686a93ac-8d66-4939-b8c1-3ef189fd1e5d,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:37.703993 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-806f155d-f748-4e15-8d6f-b43e25883194 None None] New status for floating IP f3567171-f979-4f22-a34b-d1df1a856cd8: ACTIVE {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:16:37.704546 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-ffd6ae5f-de91-4d3e-8217-a90c051497ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:37.705460 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-ffd6ae5f-de91-4d3e-8217-a90c051497ff service neutron] 10.222.0.16 "GET /v2.0/subnets?id=80d1402e-d73c-4668-9cb6-646683e6398f HTTP/1.1" status: 200 len: 854 time: 0.0620766 Nov 08 04:16:37.717363 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-254050f0-976c-41f8-869d-d567d3e0a0bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.721318 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-254050f0-976c-41f8-869d-d567d3e0a0bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3898339 Nov 08 04:16:37.721596 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56730) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:37.726902 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-7bd45003-665a-4007-a95c-78c7a908fccd tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'security_group_rule': {'security_group_id': '5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0', 'project_id': 'd23a714c188845279fa19f9c87df4def', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:37.814987 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7bd45003-665a-4007-a95c-78c7a908fccd tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.830756 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-7eb308a0-2415-429d-8f7e-da59daff0967 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:37.832205 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-7eb308a0-2415-429d-8f7e-da59daff0967 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=92ef9e7b-7c26-4986-b683-d2777b2485f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0868282 Nov 08 04:16:37.871202 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2131ec27-221b-4b25-a217-d7e166a99244 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Router 02bab738-cfe2-4e4a-8864-2604a23990ee has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:16:37.879735 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7bd45003-665a-4007-a95c-78c7a908fccd tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.954157 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7bd45003-665a-4007-a95c-78c7a908fccd tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:37.978723 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bd45003-665a-4007-a95c-78c7a908fccd tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=22470425-7094-46cf-bdea-b96687e1ce10,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:38.007637 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-d4ce65e8-bf65-49c4-9c94-da7462e8b5a0 service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1634207 Nov 08 04:16:38.041295 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7bd45003-665a-4007-a95c-78c7a908fccd tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.042671 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-7bd45003-665a-4007-a95c-78c7a908fccd tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3201079 Nov 08 04:16:38.045311 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56732) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:38.049650 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-b0b132f0-2b46-47b7-92c9-5a459f91ffe8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'security_group_rule': {'security_group_id': '5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0', 'project_id': 'd23a714c188845279fa19f9c87df4def', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:38.053289 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2131ec27-221b-4b25-a217-d7e166a99244 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:16:38.066375 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] Sync routers for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:16:38.079781 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:16:38.082835 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:38.083850 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2131ec27-221b-4b25-a217-d7e166a99244 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.118513 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-2131ec27-221b-4b25-a217-d7e166a99244 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "PUT /v2.0/floatingips/d5923b86-b8b4-4333-af31-335a334d46b9 HTTP/1.1" status: 200 len: 991 time: 1.6912472 Nov 08 04:16:38.120758 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:16:38.123117 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43710aab-a355-4206-97cf-2fde9163b2da" -d '{"events": [{"name": "network-changed", "server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:16:38.145148 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b0b132f0-2b46-47b7-92c9-5a459f91ffe8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.157998 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c4fc2f92-a088-447c-af35-4d6356f95c25 req-37da2218-79b0-4b7d-9fa4-86fade550465 service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1383078 Nov 08 04:16:38.211628 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:16:38.214901 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b0b132f0-2b46-47b7-92c9-5a459f91ffe8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.247221 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:16:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-134ad8d7-6afb-4d91-966f-b27633c49922 x-openstack-request-id: req-134ad8d7-6afb-4d91-966f-b27633c49922 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:16:38.247507 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:16:38.247754 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-134ad8d7-6afb-4d91-966f-b27633c49922 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:16:38.252664 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'status': 'completed', 'code': 200} Nov 08 04:16:38.313024 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b0b132f0-2b46-47b7-92c9-5a459f91ffe8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.329722 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43710aab-a355-4206-97cf-2fde9163b2da req-988633f9-cd47-4349-9e4b-9521c004d171 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:38.331204 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43710aab-a355-4206-97cf-2fde9163b2da req-988633f9-cd47-4349-9e4b-9521c004d171 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 1099 time: 0.0415781 Nov 08 04:16:38.336192 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b132f0-2b46-47b7-92c9-5a459f91ffe8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=19255b92-88ef-4919-94ef-e494d61d9ee1,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:38.417974 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b0b132f0-2b46-47b7-92c9-5a459f91ffe8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.419830 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-b0b132f0-2b46-47b7-92c9-5a459f91ffe8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3735678 Nov 08 04:16:38.424847 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56740) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:38.427413 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-b6e284b5-3b68-46ed-9bad-8b026556c469 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'security_group_rule': {'security_group_id': '5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0', 'project_id': 'd23a714c188845279fa19f9c87df4def', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:38.433687 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43710aab-a355-4206-97cf-2fde9163b2da req-3148687a-bb50-4ada-9c95-40a4c01334dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:38.435351 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43710aab-a355-4206-97cf-2fde9163b2da req-3148687a-bb50-4ada-9c95-40a4c01334dd service neutron] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 918 time: 0.0932004 Nov 08 04:16:38.438986 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': 'd5923b86-b8b4-4333-af31-335a334d46b9', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'floating_ip_address': '172.27.2.79', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'port_id': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 494, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'mac_address': 'fa:16:3e:70:81:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:16:22Z', 'updated_at': '2021-11-08T04:16:36Z', 'revision_number': 1, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:38.476866 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] Checking router: 02bab738-cfe2-4e4a-8864-2604a23990ee for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:16:38.486338 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:16:38.486969 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:38.509713 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43710aab-a355-4206-97cf-2fde9163b2da req-739b1008-adfa-4416-bdf2-f70a8e835bdc service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605 HTTP/1.1" status: 200 len: 999 time: 0.0639703 Nov 08 04:16:38.535041 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b6e284b5-3b68-46ed-9bad-8b026556c469 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.566539 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43710aab-a355-4206-97cf-2fde9163b2da req-efc199ae-7216-496d-8716-e45814b38275 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:38.568213 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43710aab-a355-4206-97cf-2fde9163b2da req-efc199ae-7216-496d-8716-e45814b38275 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.0509813 Nov 08 04:16:38.604577 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b6e284b5-3b68-46ed-9bad-8b026556c469 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.622963 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43710aab-a355-4206-97cf-2fde9163b2da req-d2f5bdbd-5afc-40e4-978b-eb65a8795688 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:38.624476 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43710aab-a355-4206-97cf-2fde9163b2da req-d2f5bdbd-5afc-40e4-978b-eb65a8795688 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0483813 Nov 08 04:16:38.683627 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b6e284b5-3b68-46ed-9bad-8b026556c469 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.706804 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6e284b5-3b68-46ed-9bad-8b026556c469 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6f75c668-6487-48d5-bca4-e226647dc158,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:38.720707 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:16:38.730898 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43710aab-a355-4206-97cf-2fde9163b2da req-a8b33f8b-3b06-4fa4-acff-8a137f8ef261 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0953505 Nov 08 04:16:38.796844 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b6e284b5-3b68-46ed-9bad-8b026556c469 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.800646 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-b6e284b5-3b68-46ed-9bad-8b026556c469 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3745887 Nov 08 04:16:38.800951 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56746) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:38.809519 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-e867637e-5258-41f9-a5b2-e2840cde8578 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'security_group_rule': {'security_group_id': '5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0', 'project_id': 'd23a714c188845279fa19f9c87df4def', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:38.846692 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-43710aab-a355-4206-97cf-2fde9163b2da req-3757f9e8-e698-41d6-be75-d1c6723c6d93 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1076989 Nov 08 04:16:38.916060 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.securitygroups_db [None req-e867637e-5258-41f9-a5b2-e2840cde8578 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Project d23a714c188845279fa19f9c87df4def added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 04:16:38.929098 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e867637e-5258-41f9-a5b2-e2840cde8578 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:38.970323 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': 'd5923b86-b8b4-4333-af31-335a334d46b9', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'floating_ip_address': '172.27.2.79', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'port_id': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 494, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'mac_address': 'fa:16:3e:70:81:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:16:22Z', 'updated_at': '2021-11-08T04:16:36Z', 'revision_number': 1, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:38.989547 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e867637e-5258-41f9-a5b2-e2840cde8578 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:39.000706 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2106d881-9b75-4670-8357-c2a18ed7b748 None None] The sync data for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi is: [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': 'd5923b86-b8b4-4333-af31-335a334d46b9', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'floating_ip_address': '172.27.2.79', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'port_id': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 494, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'mac_address': 'fa:16:3e:70:81:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:16:22Z', 'updated_at': '2021-11-08T04:16:36Z', 'revision_number': 1, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:16:39.060854 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e867637e-5258-41f9-a5b2-e2840cde8578 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:39.081705 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e867637e-5258-41f9-a5b2-e2840cde8578 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=682229e7-ae2f-4d45-a277-63b2f28d39bf,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:39.159761 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e867637e-5258-41f9-a5b2-e2840cde8578 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:39.160996 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e867637e-5258-41f9-a5b2-e2840cde8578 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3591828 Nov 08 04:16:39.169081 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56750) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:39.169317 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-f5a68288-30b5-4471-b54a-f618317058f0 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'security_group_rule': {'security_group_id': '5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0', 'project_id': 'd23a714c188845279fa19f9c87df4def', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:39.189120 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-780cb909-0b72-4b99-8dff-bc7b7c2dd692 None None] New status for floating IP d5923b86-b8b4-4333-af31-335a334d46b9: ACTIVE {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:16:39.267892 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.securitygroups_db [None req-f5a68288-30b5-4471-b54a-f618317058f0 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Project d23a714c188845279fa19f9c87df4def added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 04:16:39.273309 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f5a68288-30b5-4471-b54a-f618317058f0 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:39.344863 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f5a68288-30b5-4471-b54a-f618317058f0 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:39.444320 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f5a68288-30b5-4471-b54a-f618317058f0 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:39.464015 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5a68288-30b5-4471-b54a-f618317058f0 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8ae3ef52-666f-4da1-8641-fd7e3647da11,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:39.521066 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-f5a68288-30b5-4471-b54a-f618317058f0 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:39.523079 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-f5a68288-30b5-4471-b54a-f618317058f0 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3576174 Nov 08 04:16:39.614202 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-cdd4f2a2-172b-4d0b-b949-767ca6b27ae5 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-920049864&fields=id&tenant_id=d23a714c188845279fa19f9c87df4def HTTP/1.1" status: 200 len: 267 time: 0.0451558 Nov 08 04:16:39.668752 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-b310304a-2e72-471a-9b54-a74498a4db02 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:39.670271 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-b310304a-2e72-471a-9b54-a74498a4db02 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.0503368 Nov 08 04:16:39.680978 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-a240d37d-d50b-414a-ae8d-63f8f1eae03b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'port': {'security_groups': ['125bb1c5-4045-423e-afc6-df481c0f781b', '5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0']}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:39.748186 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-a240d37d-d50b-414a-ae8d-63f8f1eae03b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:39.928378 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-a240d37d-d50b-414a-ae8d-63f8f1eae03b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] For port 0afc78c5-30fe-44b8-be25-b6544e0efa0e, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:16:39.956448 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-a240d37d-d50b-414a-ae8d-63f8f1eae03b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:39.998172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-a240d37d-d50b-414a-ae8d-63f8f1eae03b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:40.038817 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['0afc78c5-30fe-44b8-be25-b6544e0efa0e'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:16:40.040299 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-a240d37d-d50b-414a-ae8d-63f8f1eae03b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:40.040825 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-a240d37d-d50b-414a-ae8d-63f8f1eae03b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:40.042783 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f0b0e381-d1c9-4ef4-966c-2953d6e3e97b req-a240d37d-d50b-414a-ae8d-63f8f1eae03b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "PUT /v2.0/ports/0afc78c5-30fe-44b8-be25-b6544e0efa0e HTTP/1.1" status: 200 len: 982 time: 0.3655643 Nov 08 04:16:40.067302 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a240d37d-d50b-414a-ae8d-63f8f1eae03b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'Port': ['ID=0afc78c5-30fe-44b8-be25-b6544e0efa0e,revision_number=6']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:40.168706 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba81fed9-11bc-43c2-ae00-9d0c5377554e req-19bbe7e7-fd67-4278-b66f-512c08e08f80 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:40.170434 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ba81fed9-11bc-43c2-ae00-9d0c5377554e req-19bbe7e7-fd67-4278-b66f-512c08e08f80 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0543625 Nov 08 04:16:40.239540 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ba81fed9-11bc-43c2-ae00-9d0c5377554e req-40d34d7a-7d22-471a-b567-e5a7caf221d2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0622153 Nov 08 04:16:40.249682 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:16:40.252460 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db1bcac6-704d-4664-9016-839cd7446c60" -d '{"events": [{"name": "network-changed", "server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:16:40.281006 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['0afc78c5-30fe-44b8-be25-b6544e0efa0e'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:16:40.289582 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:16:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bee37dac-1a45-490b-b388-d22e9e4c5a33 x-openstack-request-id: req-bee37dac-1a45-490b-b388-d22e9e4c5a33 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:16:40.289868 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:16:40.290117 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-bee37dac-1a45-490b-b388-d22e9e4c5a33 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:16:40.290533 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'status': 'completed', 'code': 200} Nov 08 04:16:40.314725 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-414c9a09-45e3-453d-befe-ae9dcd3b0ce7 None None] Provisioning complete for port 0afc78c5-30fe-44b8-be25-b6544e0efa0e triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:16:40.315040 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-414c9a09-45e3-453d-befe-ae9dcd3b0ce7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:40.375549 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1bcac6-704d-4664-9016-839cd7446c60 req-5eba2966-e328-4293-be8a-4109718a5103 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:40.377228 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-db1bcac6-704d-4664-9016-839cd7446c60 req-5eba2966-e328-4293-be8a-4109718a5103 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d23a714c188845279fa19f9c87df4def&device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 1138 time: 0.0441463 Nov 08 04:16:40.479960 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1bcac6-704d-4664-9016-839cd7446c60 req-351dd9e1-5d21-435e-971d-3b7ba8c4531c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:40.481412 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-db1bcac6-704d-4664-9016-839cd7446c60 req-351dd9e1-5d21-435e-971d-3b7ba8c4531c service neutron] 10.222.0.16 "GET /v2.0/networks?id=92ef9e7b-7c26-4986-b683-d2777b2485f6 HTTP/1.1" status: 200 len: 916 time: 0.0952590 Nov 08 04:16:40.563080 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-db1bcac6-704d-4664-9016-839cd7446c60 req-29d76ce3-c921-41c6-9cf2-e19fe00e6dfa service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e HTTP/1.1" status: 200 len: 1002 time: 0.0613272 Nov 08 04:16:40.614353 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1bcac6-704d-4664-9016-839cd7446c60 req-b83a8b4e-4123-4ea8-8dc8-5974e163ae45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:40.616493 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-db1bcac6-704d-4664-9016-839cd7446c60 req-b83a8b4e-4123-4ea8-8dc8-5974e163ae45 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=80d1402e-d73c-4668-9cb6-646683e6398f HTTP/1.1" status: 200 len: 854 time: 0.0451159 Nov 08 04:16:40.661835 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1bcac6-704d-4664-9016-839cd7446c60 req-e97d770e-4da1-42b3-9e23-a9b01a7823a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:40.664024 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-db1bcac6-704d-4664-9016-839cd7446c60 req-e97d770e-4da1-42b3-9e23-a9b01a7823a5 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=92ef9e7b-7c26-4986-b683-d2777b2485f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0395718 Nov 08 04:16:40.758097 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-db1bcac6-704d-4664-9016-839cd7446c60 req-95af4464-c8d4-420b-9854-76d0d49aea4e service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857871 Nov 08 04:16:40.850337 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-db1bcac6-704d-4664-9016-839cd7446c60 req-d4884f6f-0dec-4286-8b40-82fbbdba025d service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810304 Nov 08 04:16:41.965857 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2390e24e-a5c3-437e-908f-fb082d744814 req-c3c5a49f-034c-41d1-9607-c50191603f92 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:41.967315 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2390e24e-a5c3-437e-908f-fb082d744814 req-c3c5a49f-034c-41d1-9607-c50191603f92 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0513630 Nov 08 04:16:42.012883 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2390e24e-a5c3-437e-908f-fb082d744814 req-27185e9e-dce9-411d-9b28-3839e7e75518 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396945 Nov 08 04:16:42.644451 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-501f1ad8-8ead-4596-9bce-d7da0902ac69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:43.124683 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd54ebfe-4784-4242-b59d-8404cc0407b4 req-39da50ad-a49a-440e-85df-54af951ee600 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:43.126140 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd54ebfe-4784-4242-b59d-8404cc0407b4 req-39da50ad-a49a-440e-85df-54af951ee600 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0482779 Nov 08 04:16:43.171443 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd54ebfe-4784-4242-b59d-8404cc0407b4 req-8386f691-408c-4045-a784-e4be6ad80d9e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395269 Nov 08 04:16:44.295063 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeaa8cc4-af07-4553-9d69-b3c6c2a7df2f req-d7f25227-8d6c-4d84-a55c-27f92f8e1ce7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:44.296529 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aeaa8cc4-af07-4553-9d69-b3c6c2a7df2f req-d7f25227-8d6c-4d84-a55c-27f92f8e1ce7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0566974 Nov 08 04:16:44.345731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aeaa8cc4-af07-4553-9d69-b3c6c2a7df2f req-d6dcd897-379d-4b8a-80df-b305c9890047 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431645 Nov 08 04:16:45.147997 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-83958daa-e7bc-4175-913b-4d14ebade903 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:45.466412 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b7314de-c715-4e91-8e46-56b5814d5a59 req-b1dddcde-b2a7-4d40-a04e-ffacd3392e87 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:45.467902 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3b7314de-c715-4e91-8e46-56b5814d5a59 req-b1dddcde-b2a7-4d40-a04e-ffacd3392e87 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0500040 Nov 08 04:16:45.514964 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3b7314de-c715-4e91-8e46-56b5814d5a59 req-41168c7f-2b05-43ed-b51e-f4b30015a54c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412297 Nov 08 04:16:45.987340 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:46.460247 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-50a9b1cf-80fb-44aa-80c1-804c3491f971 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:46.462051 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-50a9b1cf-80fb-44aa-80c1-804c3491f971 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.16 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.0493977 Nov 08 04:16:46.558296 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Deleting port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:16:46.558977 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:46.679004 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] For port d997f4bb-f698-4538-b9ae-f08bec1d6ff6, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:16:46.679364 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:46.688345 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684934c5-d61a-42e9-b527-8bd92415f479 req-e641019e-9d7e-4dbf-9f1a-2aaacf62cd4f tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:46.689792 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-684934c5-d61a-42e9-b527-8bd92415f479 req-e641019e-9d7e-4dbf-9f1a-2aaacf62cd4f tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 945 time: 0.1084900 Nov 08 04:16:46.783330 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-684934c5-d61a-42e9-b527-8bd92415f479 req-89c4e5be-1b63-4b48-ada3-d70921ecb2fc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=6e7fcf69-0275-47ef-809e-470976ce212d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0860662 Nov 08 04:16:46.892247 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:46.892599 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:46.892971 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Floating IP 35b8a973-872d-4c57-91f8-7460a16e0c2e disassociated. External IP: 172.27.2.48, port: d997f4bb-f698-4538-b9ae-f08bec1d6ff6. Nov 08 04:16:46.893302 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Calling delete_port for d997f4bb-f698-4538-b9ae-f08bec1d6ff6 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:16:47.078364 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:47.103227 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event deleted for resources: {'Port': ['ID=d997f4bb-f698-4538-b9ae-f08bec1d6ff6,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:47.113525 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.113525 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.113720 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.113940 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.114272 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.114627 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.114958 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.115421 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.116134 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.116863 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.116863 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.117162 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:16:47.227125 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Router 38c2ccdd-af72-475c-872c-b75630dd8639 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:16:47.329701 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:16:47.341298 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] Sync routers for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:16:47.352522 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:16:47.353125 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:47.370763 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] No DVR routers for this DVR port d997f4bb-f698-4538-b9ae-f08bec1d6ff6 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:16:47.373244 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:47.376479 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b3d74e84-fcd6-4a25-85d8-20cb84f3f2f9 req-eea3fd7c-f7e2-44b0-950a-cc209bac20fb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.16 "DELETE /v2.0/ports/d997f4bb-f698-4538-b9ae-f08bec1d6ff6 HTTP/1.1" status: 204 len: 173 time: 0.9083102 Nov 08 04:16:47.376907 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '12c1d323-bd37-4a14-be65-7a504c81950a', 'name': 'network-vif-deleted', 'tag': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:16:47.379188 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-abf05487-1da7-43ee-8014-c474a5f4fd20" -d '{"events": [{"server_uuid": "12c1d323-bd37-4a14-be65-7a504c81950a", "name": "network-vif-deleted", "tag": "d997f4bb-f698-4538-b9ae-f08bec1d6ff6"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:16:47.421232 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:16:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ede03ce8-eae2-4b33-a75f-7123139df833 x-openstack-request-id: req-ede03ce8-eae2-4b33-a75f-7123139df833 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:16:47.421572 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "12c1d323-bd37-4a14-be65-7a504c81950a", "name": "network-vif-deleted", "tag": "d997f4bb-f698-4538-b9ae-f08bec1d6ff6", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:16:47.421826 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-ede03ce8-eae2-4b33-a75f-7123139df833 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:16:47.422218 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '12c1d323-bd37-4a14-be65-7a504c81950a', 'name': 'network-vif-deleted', 'tag': 'd997f4bb-f698-4538-b9ae-f08bec1d6ff6', 'status': 'completed', 'code': 200} Nov 08 04:16:47.468769 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:16:47.640507 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:47.690170 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:47.716814 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] Checking router: 38c2ccdd-af72-475c-872c-b75630dd8639 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:16:47.725681 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:16:47.726281 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:47.832454 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:16:47.893448 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b070b264-55e7-410b-b31a-f5d6015fda93 req-957c50de-9495-4719-baca-ef23147a6395 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=12c1d323-bd37-4a14-be65-7a504c81950a HTTP/1.1" status: 200 len: 210 time: 0.0253549 Nov 08 04:16:48.029178 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:16:48.057885 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdf48c95-3dfc-453d-b4a1-d232c4a7492a None None] The sync data for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi is: [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:16:48.270358 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c7e585a-a855-45a0-ba5f-5345a2ef147f None None] New status for floating IP 35b8a973-872d-4c57-91f8-7460a16e0c2e: DOWN {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:16:48.381902 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.027983 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56848) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:49.081175 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0d94a387-b13b-4ddc-b616-d4dec93b7c02 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.104882 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0d94a387-b13b-4ddc-b616-d4dec93b7c02 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.209824 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0d94a387-b13b-4ddc-b616-d4dec93b7c02 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.213021 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0d94a387-b13b-4ddc-b616-d4dec93b7c02 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.214176 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-0d94a387-b13b-4ddc-b616-d4dec93b7c02 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "DELETE /v2.0/security-groups/6e7fcf69-0275-47ef-809e-470976ce212d HTTP/1.1" status: 204 len: 168 time: 0.1851423 Nov 08 04:16:49.216999 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56850) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:49.223270 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d94a387-b13b-4ddc-b616-d4dec93b7c02 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e7fcf69-0275-47ef-809e-470976ce212d,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:49.230944 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.api.v2.resource [None req-eb22bc8c-6db7-4b22-8483-0ad14d2d1148 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] show failed (client error): The resource could not be found. Nov 08 04:16:49.231923 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-eb22bc8c-6db7-4b22-8483-0ad14d2d1148 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups/6e7fcf69-0275-47ef-809e-470976ce212d HTTP/1.1" status: 404 len: 347 time: 0.0139508 Nov 08 04:16:49.235303 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56852) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:49.354234 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-09926f09-8e5b-4ef4-b49a-0ab3f6134ef7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Deleting port 6c26e505-0e98-4171-a6fe-d5c07dd8f748 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:16:49.354508 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-09926f09-8e5b-4ef4-b49a-0ab3f6134ef7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.437933 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-09926f09-8e5b-4ef4-b49a-0ab3f6134ef7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.438244 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-09926f09-8e5b-4ef4-b49a-0ab3f6134ef7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.438783 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d997f4bb-f698-4538-b9ae-f08bec1d6ff6 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:16:49.450210 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-09926f09-8e5b-4ef4-b49a-0ab3f6134ef7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Calling delete_port for 6c26e505-0e98-4171-a6fe-d5c07dd8f748 owned by network:floatingip {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:16:49.459159 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: d997f4bb-f698-4538-b9ae-f08bec1d6ff6 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:16:49.459548 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d997f4bb-f698-4538-b9ae-f08bec1d6ff6 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:16:49.632496 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-09926f09-8e5b-4ef4-b49a-0ab3f6134ef7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.657693 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09926f09-8e5b-4ef4-b49a-0ab3f6134ef7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event deleted for resources: {'Port': ['ID=6c26e505-0e98-4171-a6fe-d5c07dd8f748,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:49.717598 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-09926f09-8e5b-4ef4-b49a-0ab3f6134ef7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.720107 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-09926f09-8e5b-4ef4-b49a-0ab3f6134ef7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:49.721239 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-09926f09-8e5b-4ef4-b49a-0ab3f6134ef7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "DELETE /v2.0/floatingips/35b8a973-872d-4c57-91f8-7460a16e0c2e HTTP/1.1" status: 204 len: 168 time: 0.4850459 Nov 08 04:16:49.972017 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56858) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:49.976553 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-b9284b75-8ba2-4c55-9cd6-33949c3f4716 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'security_group': {'name': 'tempest-securitygroup--49441490', 'description': 'tempest-description--995243281'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:50.072806 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b9284b75-8ba2-4c55-9cd6-33949c3f4716 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.138721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b9284b75-8ba2-4c55-9cd6-33949c3f4716 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.204209 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b9284b75-8ba2-4c55-9cd6-33949c3f4716 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.232515 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9284b75-8ba2-4c55-9cd6-33949c3f4716 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e7f67058-ad3f-4237-9829-4b107e4dea1c,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:50.274339 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b9284b75-8ba2-4c55-9cd6-33949c3f4716 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.275595 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b9284b75-8ba2-4c55-9cd6-33949c3f4716 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3025501 Nov 08 04:16:50.278608 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56864) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:50.283020 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-f31ec051-4e54-459f-84b0-e9cf5a4c2a07 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'security_group_rule': {'security_group_id': 'e7f67058-ad3f-4237-9829-4b107e4dea1c', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:50.386847 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f31ec051-4e54-459f-84b0-e9cf5a4c2a07 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.440833 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f31ec051-4e54-459f-84b0-e9cf5a4c2a07 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.462307 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 56868) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:50.507406 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f31ec051-4e54-459f-84b0-e9cf5a4c2a07 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.525611 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31ec051-4e54-459f-84b0-e9cf5a4c2a07 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fc343677-2506-471f-8e00-9cc4ebeccfc0,revision_number=0']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:50.565934 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-438794ef-3631-4f7e-84d4-8daa40e00f22 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.609378 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f31ec051-4e54-459f-84b0-e9cf5a4c2a07 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.610589 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f31ec051-4e54-459f-84b0-e9cf5a4c2a07 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3310201 Nov 08 04:16:50.613314 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56872) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:50.617856 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-c1896a2b-4b75-428a-be03-a3bb79fa90ea tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'security_group_rule': {'security_group_id': 'e7f67058-ad3f-4237-9829-4b107e4dea1c', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:50.644933 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-438794ef-3631-4f7e-84d4-8daa40e00f22 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.729747 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c1896a2b-4b75-428a-be03-a3bb79fa90ea tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.752733 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-438794ef-3631-4f7e-84d4-8daa40e00f22 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.775603 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c1896a2b-4b75-428a-be03-a3bb79fa90ea tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.790468 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-438794ef-3631-4f7e-84d4-8daa40e00f22 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=fb16764268c44eeeab69c796cf97589d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3270502 Nov 08 04:16:50.792485 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-438794ef-3631-4f7e-84d4-8daa40e00f22 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a42d50d-df64-4a28-8484-371534bf7fd2,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:50.798642 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56876) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:50.842197 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-98ec393a-a70e-4134-a4b3-3ccbeaa48bb8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.844963 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c1896a2b-4b75-428a-be03-a3bb79fa90ea tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.873439 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1896a2b-4b75-428a-be03-a3bb79fa90ea tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4f48b94c-8e00-4509-8210-65e6781c6a91,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:50.883288 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-98ec393a-a70e-4134-a4b3-3ccbeaa48bb8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.943390 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c1896a2b-4b75-428a-be03-a3bb79fa90ea tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:50.945140 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-c1896a2b-4b75-428a-be03-a3bb79fa90ea tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3303041 Nov 08 04:16:50.948174 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 56878) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:16:50.952501 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'floatingip': {'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:51.031864 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-98ec393a-a70e-4134-a4b3-3ccbeaa48bb8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:51.034329 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-98ec393a-a70e-4134-a4b3-3ccbeaa48bb8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:51.035508 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-98ec393a-a70e-4134-a4b3-3ccbeaa48bb8 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/2a42d50d-df64-4a28-8484-371534bf7fd2 HTTP/1.1" status: 204 len: 168 time: 0.2414010 Nov 08 04:16:51.043424 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ec393a-a70e-4134-a4b3-3ccbeaa48bb8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a42d50d-df64-4a28-8484-371534bf7fd2,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:51.062225 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:51.160923 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:51.266252 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Allocated IP 172.27.2.86 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/9b6c2cb0-851c-4427-af5d-9638a2e842f4) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:16:51.372978 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:51.461808 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:51.508746 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:16:51.511983 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:16:51.516798 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:16:51.520043 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'Port': ['ID=9b6c2cb0-851c-4427-af5d-9638a2e842f4,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:51.599456 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:51.711856 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:51.858412 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:51.911983 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:51.985061 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'Port': ['ID=9b6c2cb0-851c-4427-af5d-9638a2e842f4,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:51.993703 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:52.062651 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:52.063897 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-b72c8da4-74b5-4b48-a906-bc8aa66fe107 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.1147892 Nov 08 04:16:52.262718 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-c1c0b063-baf2-420f-9922-502b87e277dc tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?name=tempest-securitygroup--49441490&fields=id&tenant_id=ebd67f9cc3964c7bbc45974e8833edd2 HTTP/1.1" status: 200 len: 267 time: 0.0471654 Nov 08 04:16:52.368863 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f92cad0-ba86-46aa-a447-1258810390de req-394c105d-6b4e-478f-a9ad-79d92696ecf7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:52.370319 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-394c105d-6b4e-478f-a9ad-79d92696ecf7 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/networks?id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f HTTP/1.1" status: 200 len: 811 time: 0.1007698 Nov 08 04:16:52.385481 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-edd4afc2-aaae-497e-815e-816dcd3f92f3 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/quotas/ebd67f9cc3964c7bbc45974e8833edd2 HTTP/1.1" status: 200 len: 375 time: 0.0096047 Nov 08 04:16:52.441281 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-af406ea7-2bb3-455a-b034-d5bbb7c88e9a tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0501945 Nov 08 04:16:52.874205 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-a91b7045-6c97-415d-874b-4a990dcde15e service neutron] 10.222.0.21 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4213538 Nov 08 04:16:52.970552 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-cc5e9ceb-7cd2-4153-a65b-0d85eb8e5abe service neutron] 10.222.0.21 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0903077 Nov 08 04:16:53.202427 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-53eddf03-eb74-4c25-90c6-b9843b97143e req-44aa182a-74cd-4138-a205-c3b465a4691e tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 210 time: 0.0282722 Nov 08 04:16:54.278826 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:54.296267 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98da0d77-1e4d-4e94-8f8e-4960abe829d6 req-fe71c211-b6d0-4962-b770-44789023427c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 210 time: 0.0266321 Nov 08 04:16:54.971268 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:16:55.390969 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-52d83fa4-b2eb-4650-a56f-aa09a95a3c14 req-069ea865-c4db-4d8f-be2d-c93cc042d524 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 210 time: 0.0257380 Nov 08 04:16:56.485649 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1a1f3131-4afa-47b6-9d9a-87e1661177f7 req-94bae724-6c27-474c-8e6c-03b225f459dd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 210 time: 0.0260723 Nov 08 04:16:57.581140 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-44b52cfb-d737-42c0-ba0a-3022dba73289 req-6d51215c-696e-4db1-b0c7-f66f58212c06 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 210 time: 0.0303252 Nov 08 04:16:57.902051 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f92cad0-ba86-46aa-a447-1258810390de req-39a4a785-56c3-49c6-8050-128c39b75853 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:57.903494 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-39a4a785-56c3-49c6-8050-128c39b75853 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.16 "GET /v2.0/networks?id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f HTTP/1.1" status: 200 len: 811 time: 0.0970929 Nov 08 04:16:57.974081 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-aef64c09-bfc9-4b7f-9191-35a59d8c1371 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ebd67f9cc3964c7bbc45974e8833edd2 HTTP/1.1" status: 200 len: 378 time: 0.0520978 Nov 08 04:16:57.985322 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'port': {'device_id': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'admin_state_up': True, 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'security_groups': ['e7f67058-ad3f-4237-9829-4b107e4dea1c']}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:58.175745 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Made reservation on behalf of ebd67f9cc3964c7bbc45974e8833edd2 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:16:58.179351 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:58.305023 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Allocated IP 172.20.0.13 (bd0479b2-da8e-41bd-929c-b9ece4aaa29f/1158e941-c129-49d0-9b8b-ba72d0ef6717/2abd6ef0-1ecd-43cd-a09b-789090304b54) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:16:58.435579 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:58.530078 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:58.572218 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Network bd0479b2-da8e-41bd-929c-b9ece4aaa29f is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:16:58.575225 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:16:58.580791 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:16:58.607558 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event updated for resources: {'Port': ['ID=2abd6ef0-1ecd-43cd-a09b-789090304b54,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:58.652964 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:58.653913 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:58.716074 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb68d26-78cb-4f8b-b09c-b9a0730fb289 req-b8640b04-b2cb-41a1-8603-8f56ab86572b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:58.718168 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7eb68d26-78cb-4f8b-b09c-b9a0730fb289 req-b8640b04-b2cb-41a1-8603-8f56ab86572b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 932 time: 0.0535617 Nov 08 04:16:58.750738 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-71545ff8-24ff-448c-a1be-048f658d08fe tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7691355 Nov 08 04:16:58.772933 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7eb68d26-78cb-4f8b-b09c-b9a0730fb289 req-d5d8a327-bc71-43fc-8137-e74a6f87d945 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0484343 Nov 08 04:16:58.784466 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Request body: {'port': {'device_id': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:16:58.843709 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:58.851151 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-b162993b-2b0c-41a3-b5bb-e7a1ef6b0018 None None] Provisioning complete for port 2abd6ef0-1ecd-43cd-a09b-789090304b54 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:16:58.851648 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b162993b-2b0c-41a3-b5bb-e7a1ef6b0018 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:58.884968 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-b162993b-2b0c-41a3-b5bb-e7a1ef6b0018 None None] Port 2abd6ef0-1ecd-43cd-a09b-789090304b54 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:16:59.095679 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2abd6ef0-1ecd-43cd-a09b-789090304b54 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:16:59.103559 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:59.115377 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Transition to ACTIVE for port object 2abd6ef0-1ecd-43cd-a09b-789090304b54 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:16:59.187477 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:59.257637 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Pushing event updated for resources: {'Port': ['ID=2abd6ef0-1ecd-43cd-a09b-789090304b54,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:59.311888 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Attempting to bind port 2abd6ef0-1ecd-43cd-a09b-789090304b54 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:16:59.312262 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Attempting to bind port 2abd6ef0-1ecd-43cd-a09b-789090304b54 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:16:59.312560 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Attempting to bind port 2abd6ef0-1ecd-43cd-a09b-789090304b54 on network bd0479b2-da8e-41bd-929c-b9ece4aaa29f {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:16:59.317405 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Port 2abd6ef0-1ecd-43cd-a09b-789090304b54 on network bd0479b2-da8e-41bd-929c-b9ece4aaa29f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:16:59.317726 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Attempting to bind port 2abd6ef0-1ecd-43cd-a09b-789090304b54 on network bd0479b2-da8e-41bd-929c-b9ece4aaa29f {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:16:59.322886 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 16, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:16:59.323224 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Checking segment: {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:16:59.323606 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Bound using segment: {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:16:59.324041 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Bound port: 2abd6ef0-1ecd-43cd-a09b-789090304b54, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c986aa14-0950-49b8-b946-4f7a7bf09171', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 161, 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:16:59.324399 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:59.390226 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] For port 2abd6ef0-1ecd-43cd-a09b-789090304b54, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:16:59.397138 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] For port 2abd6ef0-1ecd-43cd-a09b-789090304b54, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=2abd6ef0-1ecd-43cd-a09b-789090304b54,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:16:59.467955 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:59.502742 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:59.503358 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:16:59.504721 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] 10.222.0.16 "PUT /v2.0/ports/2abd6ef0-1ecd-43cd-a09b-789090304b54 HTTP/1.1" status: 200 len: 1094 time: 0.7244873 Nov 08 04:16:59.505156 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'tag': '2abd6ef0-1ecd-43cd-a09b-789090304b54'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:16:59.507432 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bfc0959b-3cd4-4f57-bdb9-d1293cae3502" -d '{"events": [{"name": "network-changed", "server_uuid": "783afda2-d37a-42f5-a3b3-d2f0b3cde4ca", "tag": "2abd6ef0-1ecd-43cd-a09b-789090304b54"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:16:59.538208 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58de7a63-6f40-4909-94b5-e7ea5b75adcb service neutron] Pushing event updated for resources: {'Port': ['ID=2abd6ef0-1ecd-43cd-a09b-789090304b54,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:16:59.558905 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:16:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c4dcfc90-de27-4ad0-becc-c00558cbe1e5 x-openstack-request-id: req-c4dcfc90-de27-4ad0-becc-c00558cbe1e5 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:16:59.558905 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "783afda2-d37a-42f5-a3b3-d2f0b3cde4ca", "tag": "2abd6ef0-1ecd-43cd-a09b-789090304b54", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:16:59.558905 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-c4dcfc90-de27-4ad0-becc-c00558cbe1e5 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:16:59.558905 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'tag': '2abd6ef0-1ecd-43cd-a09b-789090304b54', 'status': 'completed', 'code': 200} Nov 08 04:16:59.788676 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc0959b-3cd4-4f57-bdb9-d1293cae3502 req-d64ef545-c87d-48cf-8739-9cb3cd8e3dd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:59.790780 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bfc0959b-3cd4-4f57-bdb9-d1293cae3502 req-d64ef545-c87d-48cf-8739-9cb3cd8e3dd3 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 1097 time: 0.0415008 Nov 08 04:16:59.937998 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc0959b-3cd4-4f57-bdb9-d1293cae3502 req-6e7cdedb-5144-4f9d-8222-cc756a196ad7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:59.939628 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bfc0959b-3cd4-4f57-bdb9-d1293cae3502 req-6e7cdedb-5144-4f9d-8222-cc756a196ad7 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1304529 Nov 08 04:16:59.948554 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c4ebbb-33fb-49b3-bab0-dce216868371 req-e3810dbe-f229-491f-9914-9161a1147042 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:16:59.949965 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e4c4ebbb-33fb-49b3-bab0-dce216868371 req-e3810dbe-f229-491f-9914-9161a1147042 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 944 time: 0.1010940 Nov 08 04:17:00.052925 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e4c4ebbb-33fb-49b3-bab0-dce216868371 req-8b02804a-c903-4fd8-805b-0083d406ca20 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0969768 Nov 08 04:17:00.086781 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc0959b-3cd4-4f57-bdb9-d1293cae3502 req-ffd29a1e-a801-4985-8bd1-5084025297a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:00.088291 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bfc0959b-3cd4-4f57-bdb9-d1293cae3502 req-ffd29a1e-a801-4985-8bd1-5084025297a1 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1243570 Nov 08 04:17:00.203406 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f92cad0-ba86-46aa-a447-1258810390de req-7b9604e3-b0a3-4b5f-bde6-5e471bcfa624 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:00.204793 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-7b9604e3-b0a3-4b5f-bde6-5e471bcfa624 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 1097 time: 0.0441699 Nov 08 04:17:00.257667 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-a56a0d5b-960c-438e-b51d-14bf2f255e12 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=2abd6ef0-1ecd-43cd-a09b-789090304b54 HTTP/1.1" status: 200 len: 217 time: 0.0373690 Nov 08 04:17:00.307239 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f92cad0-ba86-46aa-a447-1258810390de req-f3acb7d9-584d-4652-889d-8a43ccf37c27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:00.308623 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-f3acb7d9-584d-4652-889d-8a43ccf37c27 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=1158e941-c129-49d0-9b8b-ba72d0ef6717 HTTP/1.1" status: 200 len: 850 time: 0.0422359 Nov 08 04:17:00.354428 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f92cad0-ba86-46aa-a447-1258810390de req-9a79e0c2-7bf9-44f6-bbef-6908bfe01f24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:00.355925 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-9a79e0c2-7bf9-44f6-bbef-6908bfe01f24 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392506 Nov 08 04:17:00.451677 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-3942caf1-5fde-41cf-8da4-d148f670f1ed service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864124 Nov 08 04:17:00.543863 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f92cad0-ba86-46aa-a447-1258810390de req-b44088b4-9e7b-438d-8ce6-c0aa3a7850e8 service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839541 Nov 08 04:17:01.184191 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27d89bb3-f140-4a48-8b94-36040fba35ab req-d3412995-2a34-4a2b-ab32-0ce31d3afd89 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:01.186084 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-27d89bb3-f140-4a48-8b94-36040fba35ab req-d3412995-2a34-4a2b-ab32-0ce31d3afd89 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 944 time: 0.0582798 Nov 08 04:17:01.234709 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-27d89bb3-f140-4a48-8b94-36040fba35ab req-8c0530a2-0395-4318-80e5-b0f9c5e62a31 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0422637 Nov 08 04:17:01.525689 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57012) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:01.635426 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d55eeeab-6d4d-4c59-80d0-6867724430d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:01.705666 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d55eeeab-6d4d-4c59-80d0-6867724430d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:01.769714 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d55eeeab-6d4d-4c59-80d0-6867724430d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:01.807131 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-d55eeeab-6d4d-4c59-80d0-6867724430d4 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=b64d273a14184c1f9e88f8f0d10f82ad&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2803464 Nov 08 04:17:01.808228 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d55eeeab-6d4d-4c59-80d0-6867724430d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7705f7ba-ab3c-4b91-9dfd-272b04ea30b2,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:01.809831 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 57016) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:01.856171 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0838470f-6381-4a09-b14a-16166bacf11f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:01.877414 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0838470f-6381-4a09-b14a-16166bacf11f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:01.987102 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0838470f-6381-4a09-b14a-16166bacf11f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:01.989644 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0838470f-6381-4a09-b14a-16166bacf11f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:01.990801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-0838470f-6381-4a09-b14a-16166bacf11f admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/7705f7ba-ab3c-4b91-9dfd-272b04ea30b2 HTTP/1.1" status: 204 len: 168 time: 0.1798835 Nov 08 04:17:01.998981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0838470f-6381-4a09-b14a-16166bacf11f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7705f7ba-ab3c-4b91-9dfd-272b04ea30b2,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:02.347406 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e6a48c-99a7-46fe-97f6-cbba0b548a8b req-49d64fe9-6fb3-426c-b767-34d85002e732 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:02.348896 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62e6a48c-99a7-46fe-97f6-cbba0b548a8b req-49d64fe9-6fb3-426c-b767-34d85002e732 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 944 time: 0.0487947 Nov 08 04:17:02.400457 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62e6a48c-99a7-46fe-97f6-cbba0b548a8b req-6a724a93-403a-4ae5-a81a-30fba29dfd1c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0451560 Nov 08 04:17:02.932902 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 57042) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:03.024931 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1229405597-network', 'tenant_id': '9e6436a3d5084995840a192763eea4ae'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:03.112551 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Made reservation on behalf of 9e6436a3d5084995840a192763eea4ae for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:17:03.114857 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.123811 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.193305 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.244284 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.265206 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] vlan segment allocate from pool success with {'vlan_id': 190, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:17:03.281444 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0598b459-c037-4092-ba8c-923aa094a625,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:03.284296 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.284639 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Added segment 3195749d-d797-4105-b176-934eef1ae577 of type vlan for network 6fbc518a-d762-4340-b3c4-10e04086e375 Nov 08 04:17:03.323326 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.386889 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.387846 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:03.388413 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.453245 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] Pushing event updated for resources: {'Network': ['ID=6fbc518a-d762-4340-b3c4-10e04086e375,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:03.464809 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 6fbc518a-d762-4340-b3c4-10e04086e375 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:17:03.504794 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57052) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:03.510017 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Request body: {'subnet': {'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1229405597-subnet', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:03.510189 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-068aabf0-6cfb-4c08-a93b-af023d0b10d6 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5759940 Nov 08 04:17:03.546276 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 2abd6ef0-1ecd-43cd-a09b-789090304b54 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:17:03.548291 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553dd33f-9e78-4141-9a43-f3927f351e00 req-55afe141-2f5d-4885-b325-002a6bb0d5c2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:03.549787 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-553dd33f-9e78-4141-9a43-f3927f351e00 req-55afe141-2f5d-4885-b325-002a6bb0d5c2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 944 time: 0.0619245 Nov 08 04:17:03.588614 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Made reservation on behalf of 9e6436a3d5084995840a192763eea4ae for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:17:03.596082 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5043309'] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.620466 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-553dd33f-9e78-4141-9a43-f3927f351e00 req-3a351553-81c5-4bae-ac3d-e965156e7e61 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0639670 Nov 08 04:17:03.657578 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 2abd6ef0-1ecd-43cd-a09b-789090304b54, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=2abd6ef0-1ecd-43cd-a09b-789090304b54,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:03.669250 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '2abd6ef0-1ecd-43cd-a09b-789090304b54', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'port_id': '2abd6ef0-1ecd-43cd-a09b-789090304b54', 'mac_address': 'fa:16:3e:50:77:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 161, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:17:03.713151 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.726741 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2abd6ef0-1ecd-43cd-a09b-789090304b54 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:17:03.746152 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 2abd6ef0-1ecd-43cd-a09b-789090304b54, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=2abd6ef0-1ecd-43cd-a09b-789090304b54,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:03.810093 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.827463 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5120956', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5043607'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:03.857110 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=2abd6ef0-1ecd-43cd-a09b-789090304b54,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:03.864497 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.864844 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.865186 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.865527 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.865843 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.866164 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.866529 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.866826 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.867171 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.867486 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.867799 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.868113 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:03.887106 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cde96b9f-aad6-4299-909d-9e2c0a335515,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:03.898239 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Checking segment: {'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:17:03.899263 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Network hostable DHCP agents. Network: 6fbc518a-d762-4340-b3c4-10e04086e375, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:17:03.952696 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Network 6fbc518a-d762-4340-b3c4-10e04086e375 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:17:04.003729 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 6fbc518a-d762-4340-b3c4-10e04086e375) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:04.007571 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:04.008767 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.013194 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be51ecea-0bad-4661-9c55-0dd12f517b1c None None] Network 6fbc518a-d762-4340-b3c4-10e04086e375 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:17:04.075725 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a73a87b6-d505-4cf5-a5a5-ec9dbb624a69 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5695961 Nov 08 04:17:04.078671 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 57054) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:04.085627 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:04.154344 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp69aa137b-4136-5a6b-bf5e-deeb8c067c65-6fbc518a-d762-4340-b3c4-10e04086e375', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515'}]}} from dv-cinder-783643-4-iscsi. {{(pid=101666) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 04:17:04.155231 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.157692 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-701463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7538'] for router, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.161853 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-701603', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-688686', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-770197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7531'] for router, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.161975 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['2abd6ef0-1ecd-43cd-a09b-789090304b54'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:17:04.212498 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.358390 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.db_base_plugin_common [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Allocated IP 172.20.0.2 (6fbc518a-d762-4340-b3c4-10e04086e375/cde96b9f-aad6-4299-909d-9e2c0a335515/a97ab861-3913-4fe9-8e16-f93af362dcd6) {{(pid=101666) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:17:04.425152 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.651051 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Publish callbacks [] for port, precommit_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.688306 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.723825 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.729709 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.765839 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Network 6fbc518a-d762-4340-b3c4-10e04086e375 is already hosted by enough agents. {{(pid=101666) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:17:04.768770 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.base_scheduler [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Resources bound (agent type, host, resource id): {{(pid=101666) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:04.773056 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Received port after_create {{(pid=101666) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:17:04.776651 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Pushing event updated for resources: {'Port': ['ID=a97ab861-3913-4fe9-8e16-f93af362dcd6,revision_number=1']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:04.792061 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56dc4f8-205b-4b74-b26c-62f0ac3c6f46 req-7c28caf6-5d1a-4241-a5ff-52bd888f23d9 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:04.793553 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e56dc4f8-205b-4b74-b26c-62f0ac3c6f46 req-7c28caf6-5d1a-4241-a5ff-52bd888f23d9 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 945 time: 0.1074407 Nov 08 04:17:04.827289 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Attempting to bind port a97ab861-3913-4fe9-8e16-f93af362dcd6 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:17:04.827661 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Attempting to bind port a97ab861-3913-4fe9-8e16-f93af362dcd6 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:17:04.828021 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Attempting to bind port a97ab861-3913-4fe9-8e16-f93af362dcd6 on network 6fbc518a-d762-4340-b3c4-10e04086e375 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:17:04.832905 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 16, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:17:04.833280 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Checking segment: {'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:17:04.833708 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.834097 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Bound using segment: {'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:17:04.834583 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Bound port: a97ab861-3913-4fe9-8e16-f93af362dcd6, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:17:04.834963 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.875296 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e56dc4f8-205b-4b74-b26c-62f0ac3c6f46 req-bb02d932-d8fa-4592-b97c-4b9c0bbe456b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0742815 Nov 08 04:17:04.890847 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Allocated IP 172.27.2.168 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/a996d7df-a0ce-4dc7-821e-00c39172b3f6) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:17:04.902016 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] For port a97ab861-3913-4fe9-8e16-f93af362dcd6, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:17:04.907238 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] For port a97ab861-3913-4fe9-8e16-f93af362dcd6, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=a97ab861-3913-4fe9-8e16-f93af362dcd6,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:17:04.982030 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:04.994002 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:05.042560 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00224ad6-8b85-4042-bae6-11eaeb1cb438 None None] Pushing event updated for resources: {'Port': ['ID=a97ab861-3913-4fe9-8e16-f93af362dcd6,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:05.096091 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:05.134792 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:17:05.139816 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:05.143442 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:17:05.165768 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Pushing event updated for resources: {'Port': ['ID=a996d7df-a0ce-4dc7-821e-00c39172b3f6,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:05.494916 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:05.567484 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 2abd6ef0-1ecd-43cd-a09b-789090304b54 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:05.678539 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 2abd6ef0-1ecd-43cd-a09b-789090304b54 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:17:05.683270 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 2abd6ef0-1ecd-43cd-a09b-789090304b54 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:05.683643 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:05.696383 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-701612', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891'] for router, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:05.770738 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:05.795405 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2abd6ef0-1ecd-43cd-a09b-789090304b54'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:17:05.797692 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c330823-3558-47ef-8295-550e8a853fa3" -d '{"events": [{"server_uuid": "783afda2-d37a-42f5-a3b3-d2f0b3cde4ca", "name": "network-vif-plugged", "status": "completed", "tag": "2abd6ef0-1ecd-43cd-a09b-789090304b54"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:17:05.820058 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 2abd6ef0-1ecd-43cd-a09b-789090304b54, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=2abd6ef0-1ecd-43cd-a09b-789090304b54,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:05.868462 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:05.936825 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=2abd6ef0-1ecd-43cd-a09b-789090304b54,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:05.949296 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea8a740d-b636-4b34-9fc9-ec31bfc6d90f None None] Network 6fbc518a-d762-4340-b3c4-10e04086e375 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:17:05.982573 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:17:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99e829ce-a1a7-4e97-bfcd-0a5889cdd67b x-openstack-request-id: req-99e829ce-a1a7-4e97-bfcd-0a5889cdd67b {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:17:05.982857 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "783afda2-d37a-42f5-a3b3-d2f0b3cde4ca", "name": "network-vif-plugged", "status": "completed", "tag": "2abd6ef0-1ecd-43cd-a09b-789090304b54", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:17:05.983366 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-99e829ce-a1a7-4e97-bfcd-0a5889cdd67b {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:17:05.983749 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2abd6ef0-1ecd-43cd-a09b-789090304b54', 'code': 200} Nov 08 04:17:06.035236 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-7e6e5e09-3465-4116-8860-3aebbd89e2ed None None] Provisioning complete for port a97ab861-3913-4fe9-8e16-f93af362dcd6 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:06.035494 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7e6e5e09-3465-4116-8860-3aebbd89e2ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:06.100988 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6a243e-e7ea-4898-b6f9-5b77c90da820 req-8b9b9774-3305-49a3-a45f-5d5683ef3082 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:06.102978 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4a6a243e-e7ea-4898-b6f9-5b77c90da820 req-8b9b9774-3305-49a3-a45f-5d5683ef3082 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 946 time: 0.0670187 Nov 08 04:17:06.160156 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4a6a243e-e7ea-4898-b6f9-5b77c90da820 req-1982b0a4-b3d8-4923-bf4c-135c2f2782dd tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0502527 Nov 08 04:17:06.180259 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7e6e5e09-3465-4116-8860-3aebbd89e2ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:06.198530 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Router 8d32ec67-9649-4b0a-b473-c593c138b81b is scheduled to L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 with binding_index 1 {{(pid=101665) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 04:17:06.220454 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-7e6e5e09-3465-4116-8860-3aebbd89e2ed None None] For port a97ab861-3913-4fe9-8e16-f93af362dcd6, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=a97ab861-3913-4fe9-8e16-f93af362dcd6,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:06.284788 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7e6e5e09-3465-4116-8860-3aebbd89e2ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:06.331279 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:17:06.334515 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e6e5e09-3465-4116-8860-3aebbd89e2ed None None] Pushing event updated for resources: {'Port': ['ID=a97ab861-3913-4fe9-8e16-f93af362dcd6,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:06.347855 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Sync routers for ids ['8d32ec67-9649-4b0a-b473-c593c138b81b'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:17:06.348010 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0cedf6b-e1f1-43e0-aaff-3eaacc9f87b1 req-9a3344c5-3478-4a1d-87fa-1fb5baa5afa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:06.349411 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d0cedf6b-e1f1-43e0-aaff-3eaacc9f87b1 req-9a3344c5-3478-4a1d-87fa-1fb5baa5afa8 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 1099 time: 0.0628383 Nov 08 04:17:06.361937 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Routers {'8d32ec67-9649-4b0a-b473-c593c138b81b'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:06.362586 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8d32ec67-9649-4b0a-b473-c593c138b81b'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:06.403170 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d0cedf6b-e1f1-43e0-aaff-3eaacc9f87b1 req-852c0503-e4e5-4286-abf0-f95985b42971 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0443368 Nov 08 04:17:06.440264 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] Publish callbacks [] for router, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:06.441397 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-bb35d8ae-8181-4397-bfc1-04b50cc9b55f admin admin] 10.222.0.21 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.3616643 Nov 08 04:17:06.444150 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 57068) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:06.468975 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Set router 8d32ec67-9649-4b0a-b473-c593c138b81b gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:06.561677 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-7b67980f-9a68-43b2-b9d0-96fc2c847d6f None None] Provisioning complete for port a97ab861-3913-4fe9-8e16-f93af362dcd6 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:06.562048 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b67980f-9a68-43b2-b9d0-96fc2c847d6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:06.731035 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:05Z', 'revision_number': 3, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:06.760680 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Checking router: 8d32ec67-9649-4b0a-b473-c593c138b81b for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:17:06.761022 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Updating router 8d32ec67-9649-4b0a-b473-c593c138b81b port a996d7df-a0ce-4dc7-821e-00c39172b3f6 binding host dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:17:06.787547 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:06.858786 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.011159 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Allocated IP 172.20.0.1 (6fbc518a-d762-4340-b3c4-10e04086e375/cde96b9f-aad6-4299-909d-9e2c0a335515/0aae4312-8f40-413f-b687-6b651ec25acd) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:17:07.030070 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Publish callbacks [] for port, precommit_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.089851 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.106812 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.137358 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Attempting to bind port a996d7df-a0ce-4dc7-821e-00c39172b3f6 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:17:07.137723 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Attempting to bind port a996d7df-a0ce-4dc7-821e-00c39172b3f6 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:17:07.138181 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Attempting to bind port a996d7df-a0ce-4dc7-821e-00c39172b3f6 on network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:17:07.148147 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63da23c5-5f5c-4567-a33e-731ebc594492 None None] Pushing event updated for resources: {'Port': ['ID=a996d7df-a0ce-4dc7-821e-00c39172b3f6,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:07.149687 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 16, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:17:07.149687 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:17:07.150076 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.150400 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Bound using segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:17:07.150890 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Bound port: a996d7df-a0ce-4dc7-821e-00c39172b3f6, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:17:07.151270 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.187770 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.210657 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] For port a996d7df-a0ce-4dc7-821e-00c39172b3f6, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:17:07.214047 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] For port a996d7df-a0ce-4dc7-821e-00c39172b3f6, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=a996d7df-a0ce-4dc7-821e-00c39172b3f6,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:17:07.232816 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device a97ab861-3913-4fe9-8e16-f93af362dcd6 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:07.235288 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Network 6fbc518a-d762-4340-b3c4-10e04086e375 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:17:07.238415 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:07.245500 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:17:07.260430 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.288417 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Pushing event updated for resources: {'Port': ['ID=0aae4312-8f40-413f-b687-6b651ec25acd,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:07.324035 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-703278'] for router_interface, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.341163 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Routers {'8d32ec67-9649-4b0a-b473-c593c138b81b'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:07.341779 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8d32ec67-9649-4b0a-b473-c593c138b81b'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:07.347077 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63da23c5-5f5c-4567-a33e-731ebc594492 None None] Pushing event updated for resources: {'Port': ['ID=a996d7df-a0ce-4dc7-821e-00c39172b3f6,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:07.373753 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af80acf5-3edc-4301-b63c-ab4d0816efba req-43129b9c-aa58-4f25-be8f-0d5281c4ee2c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:07.375353 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af80acf5-3edc-4301-b63c-ab4d0816efba req-43129b9c-aa58-4f25-be8f-0d5281c4ee2c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 946 time: 0.1034462 Nov 08 04:17:07.392665 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port a97ab861-3913-4fe9-8e16-f93af362dcd6 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:07.393034 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.482785 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af80acf5-3edc-4301-b63c-ab4d0816efba req-e5858754-308e-42ba-b3fa-f439bc42de6c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0934119 Nov 08 04:17:07.562251 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.636703 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-f17c32fd-4535-4d51-911d-260e34bcd605 None None] Provisioning complete for port 0aae4312-8f40-413f-b687-6b651ec25acd triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:07.637053 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f17c32fd-4535-4d51-911d-260e34bcd605 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.639640 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] Set router 8d32ec67-9649-4b0a-b473-c593c138b81b gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:07.727234 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.792854 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-f17c32fd-4535-4d51-911d-260e34bcd605 None None] Port 0aae4312-8f40-413f-b687-6b651ec25acd cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:17:07.803554 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.874835 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Pushing event updated for resources: {'Port': ['ID=0aae4312-8f40-413f-b687-6b651ec25acd,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:07.877133 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530987', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-703418'] for router_interface, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:07.890056 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:05Z', 'revision_number': 3, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:07.916434 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86c20290-b79d-4e65-8882-53437ea3d815 None None] The sync data for ids ['8d32ec67-9649-4b0a-b473-c593c138b81b'] in dv-cinder-783643-4-iscsi is: [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:05Z', 'revision_number': 3, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:17:07.974190 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Network 6fbc518a-d762-4340-b3c4-10e04086e375 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:17:07.975669 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:08.097212 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Router 8d32ec67-9649-4b0a-b473-c593c138b81b has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:17:08.217828 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-0761f26c-b860-4597-9a45-7f629f54ea9d None None] Provisioning complete for port 0aae4312-8f40-413f-b687-6b651ec25acd triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:08.218764 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-0761f26c-b860-4597-9a45-7f629f54ea9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:08.229948 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:17:08.235532 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-18b611cf-6fd2-4c6f-b150-ff653e192fb3 admin admin] 10.222.0.21 "PUT /v2.0/routers/8d32ec67-9649-4b0a-b473-c593c138b81b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7903037 Nov 08 04:17:08.261330 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-0761f26c-b860-4597-9a45-7f629f54ea9d None None] Port 0aae4312-8f40-413f-b687-6b651ec25acd cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:17:08.599110 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d75b4a-8d40-48ec-8c33-beb370d802a6 req-a65b0e46-fa4a-4b9a-9e0b-e9e3b707d75a tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:08.600728 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-36d75b4a-8d40-48ec-8c33-beb370d802a6 req-a65b0e46-fa4a-4b9a-9e0b-e9e3b707d75a tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 946 time: 0.0518293 Nov 08 04:17:08.654085 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-36d75b4a-8d40-48ec-8c33-beb370d802a6 req-1037e00b-3377-4e0e-9a78-df9e72724d27 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0467160 Nov 08 04:17:08.776622 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2a67290-c1b2-4e55-a8bc-2225be4a5e7e req-17f34efc-68d5-47d0-9534-410483c65a2c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:08.778087 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c2a67290-c1b2-4e55-a8bc-2225be4a5e7e req-17f34efc-68d5-47d0-9534-410483c65a2c tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 946 time: 0.0499477 Nov 08 04:17:08.786418 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 57090) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:08.791473 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-322ce9c0-c206-43c6-910e-ba09ef506588 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Request body: {'floatingip': {'port_id': '2abd6ef0-1ecd-43cd-a09b-789090304b54'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:08.828833 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-322ce9c0-c206-43c6-910e-ba09ef506588 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:08.943585 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57098) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:08.951570 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-32901558-network', 'tenant_id': 'feaf2b62333641368f5719dbadce824f'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:09.038658 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Made reservation on behalf of feaf2b62333641368f5719dbadce824f for: {'network': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:17:09.041135 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.050382 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.122928 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.204595 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.222744 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device a996d7df-a0ce-4dc7-821e-00c39172b3f6 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:09.237725 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] vlan segment allocate from pool success with {'vlan_id': 198, 'physical_network': 'physnet1'} {{(pid=101664) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:17:09.254078 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=371086ce-2771-42d8-84b1-8022640364e7,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:09.259078 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.259640 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.segments_db [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Added segment 96d21411-2303-43dc-b36f-5eeb64f10618 of type vlan for network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 Nov 08 04:17:09.277657 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port a996d7df-a0ce-4dc7-821e-00c39172b3f6 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:09.278198 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.307063 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.328333 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-322ce9c0-c206-43c6-910e-ba09ef506588 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.360335 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.381842 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port a996d7df-a0ce-4dc7-821e-00c39172b3f6, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=a996d7df-a0ce-4dc7-821e-00c39172b3f6,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:09.403268 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-322ce9c0-c206-43c6-910e-ba09ef506588 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.433154 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.434466 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:09.435395 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.490319 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.501649 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] Pushing event updated for resources: {'Network': ['ID=40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:09.514871 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [None req-322ce9c0-c206-43c6-910e-ba09ef506588 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Floating IP 9d8caa52-e595-4dfa-81af-5002d8042e90 associated. External IP: 172.27.2.86, port: 2abd6ef0-1ecd-43cd-a09b-789090304b54. Nov 08 04:17:09.522269 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:17:09.535469 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-7c68ce94-410e-4999-a387-473ef16e6ef1 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 0.5894897 Nov 08 04:17:09.537278 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57102) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:09.546803 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Request body: {'subnet': {'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-32901558-subnet', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:09.566387 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Sync routers for ids ['8d32ec67-9649-4b0a-b473-c593c138b81b'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:17:09.579355 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Routers {'8d32ec67-9649-4b0a-b473-c593c138b81b'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:09.580290 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8d32ec67-9649-4b0a-b473-c593c138b81b'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:09.611763 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=a996d7df-a0ce-4dc7-821e-00c39172b3f6,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:09.655560 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Made reservation on behalf of feaf2b62333641368f5719dbadce824f for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:17:09.658068 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5043309'] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.699564 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Set router 8d32ec67-9649-4b0a-b473-c593c138b81b gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:09.754399 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-322ce9c0-c206-43c6-910e-ba09ef506588 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Router 38c2ccdd-af72-475c-872c-b75630dd8639 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:17:09.864913 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-322ce9c0-c206-43c6-910e-ba09ef506588 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:17:09.869698 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-322ce9c0-c206-43c6-910e-ba09ef506588 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.875973 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] Sync routers for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:17:09.885934 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:09.886587 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:09.890608 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5120956', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5043607'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:09.900731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-322ce9c0-c206-43c6-910e-ba09ef506588 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "PUT /v2.0/floatingips/9d8caa52-e595-4dfa-81af-5002d8042e90 HTTP/1.1" status: 200 len: 991 time: 1.1128297 Nov 08 04:17:09.901857 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'tag': '2abd6ef0-1ecd-43cd-a09b-789090304b54'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:17:09.905930 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-91208d51-ebdb-439a-b586-0822cecbb812" -d '{"events": [{"name": "network-changed", "server_uuid": "783afda2-d37a-42f5-a3b3-d2f0b3cde4ca", "tag": "2abd6ef0-1ecd-43cd-a09b-789090304b54"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:17:09.940489 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0aae4312-8f40-413f-b687-6b651ec25acd', 'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'mac_address': 'fa:16:3e:e1:0b:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:06Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 2, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'subnets': [{'id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:09.966447 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6bbd9ae0-de11-4b7d-a466-be22da39973f,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:09.975976 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Checking router: 8d32ec67-9649-4b0a-b473-c593c138b81b for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:17:09.977451 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Updating router 8d32ec67-9649-4b0a-b473-c593c138b81b port 0aae4312-8f40-413f-b687-6b651ec25acd binding host dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:17:09.983684 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Checking segment: {'id': '96d21411-2303-43dc-b36f-5eeb64f10618', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:17:09.984042 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Network hostable DHCP agents. Network: 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:17:09.994434 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:17:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f6e76098-45e5-4f41-bcbe-bd0084dd485e x-openstack-request-id: req-f6e76098-45e5-4f41-bcbe-bd0084dd485e {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:17:09.994756 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "783afda2-d37a-42f5-a3b3-d2f0b3cde4ca", "tag": "2abd6ef0-1ecd-43cd-a09b-789090304b54", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:17:09.995012 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-f6e76098-45e5-4f41-bcbe-bd0084dd485e {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:17:09.995813 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'tag': '2abd6ef0-1ecd-43cd-a09b-789090304b54', 'status': 'completed', 'code': 200} Nov 08 04:17:10.007765 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.026177 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:10.067895 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:17:10.105265 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91208d51-ebdb-439a-b586-0822cecbb812 req-8914494b-18e8-46a8-9c42-0a234c86c220 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:10.107089 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91208d51-ebdb-439a-b586-0822cecbb812 req-8914494b-18e8-46a8-9c42-0a234c86c220 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 1099 time: 0.0471325 Nov 08 04:17:10.124964 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:10.132152 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:10.132152 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.146578 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b58c8a6-e7d9-4ec2-a9df-fbaebbe8496e None None] Network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:17:10.203022 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-71d56a6f-e82b-4e16-8513-e4bdfb6db177 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 843 time: 0.6627841 Nov 08 04:17:10.204362 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57114) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:10.213846 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-32901558-router', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:10.284383 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91208d51-ebdb-439a-b586-0822cecbb812 req-2a4e2b67-9afa-46c0-825a-9963c60398b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:10.286040 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91208d51-ebdb-439a-b586-0822cecbb812 req-2a4e2b67-9afa-46c0-825a-9963c60398b9 service neutron] 10.222.0.16 "GET /v2.0/networks?id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f HTTP/1.1" status: 200 len: 912 time: 0.1494031 Nov 08 04:17:10.336624 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-701463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-7538'] for router, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.338036 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-701603', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-688686', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-770197', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-7531'] for router, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.357821 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91208d51-ebdb-439a-b586-0822cecbb812 req-cf642cbd-e532-4873-9438-362fa9a6b2bc service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=2abd6ef0-1ecd-43cd-a09b-789090304b54 HTTP/1.1" status: 200 len: 999 time: 0.0636866 Nov 08 04:17:10.367437 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Publish callbacks [] for port, precommit_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.401253 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp69aa137b-4136-5a6b-bf5e-deeb8c067c65-40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7', 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'fixed_ips': [{'subnet_id': '6bbd9ae0-de11-4b7d-a466-be22da39973f'}]}} from dv-cinder-783643-4-iscsi. {{(pid=101666) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 08 04:17:10.401836 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.403817 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.418307 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91208d51-ebdb-439a-b586-0822cecbb812 req-f7cfdf2e-294e-42c1-b25f-056042ab3b06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:10.419770 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91208d51-ebdb-439a-b586-0822cecbb812 req-f7cfdf2e-294e-42c1-b25f-056042ab3b06 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=1158e941-c129-49d0-9b8b-ba72d0ef6717 HTTP/1.1" status: 200 len: 850 time: 0.0484164 Nov 08 04:17:10.425252 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '9d8caa52-e595-4dfa-81af-5002d8042e90', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'floating_ip_address': '172.27.2.86', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'port_id': '2abd6ef0-1ecd-43cd-a09b-789090304b54', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 518, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'mac_address': 'fa:16:3e:50:77:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:16:51Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 1, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:10.450132 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.457194 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] Checking router: 38c2ccdd-af72-475c-872c-b75630dd8639 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:17:10.472544 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91208d51-ebdb-439a-b586-0822cecbb812 req-c4b00ad7-fe4c-49ca-8652-599b7ccf0e19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:10.474051 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91208d51-ebdb-439a-b586-0822cecbb812 req-c4b00ad7-fe4c-49ca-8652-599b7ccf0e19 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=bd0479b2-da8e-41bd-929c-b9ece4aaa29f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0451653 Nov 08 04:17:10.519724 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:10.520285 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:10.524682 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Pushing event updated for resources: {'Port': ['ID=0aae4312-8f40-413f-b687-6b651ec25acd,revision_number=3']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:10.578461 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.579340 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.579694 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.580172 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.580511 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.580858 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.581197 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.581528 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.581883 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.582219 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.589260 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.589469 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101667) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:10.676731 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Attempting to bind port 0aae4312-8f40-413f-b687-6b651ec25acd on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:17:10.677021 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Attempting to bind port 0aae4312-8f40-413f-b687-6b651ec25acd by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:17:10.677389 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Attempting to bind port 0aae4312-8f40-413f-b687-6b651ec25acd on network 6fbc518a-d762-4340-b3c4-10e04086e375 {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:17:10.691311 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 16, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:17:10.691762 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Checking segment: {'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101667) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:17:10.692080 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.692478 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Bound using segment: {'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:17:10.692950 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Bound port: 0aae4312-8f40-413f-b687-6b651ec25acd, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'}}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:17:10.693608 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.722596 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.db_base_plugin_common [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Allocated IP 172.20.0.2 (40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7/6bbd9ae0-de11-4b7d-a466-be22da39973f/0cb67928-147b-4619-9679-bd929dadb50d) {{(pid=101666) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:17:10.740454 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91208d51-ebdb-439a-b586-0822cecbb812 req-c4f6df83-5f02-47d1-920a-86176a797079 service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2561219 Nov 08 04:17:10.742819 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:10.768874 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa8ba58-9f68-4782-b31e-6dac65eb8273 req-a42ac54b-d858-47c2-b897-1c0f3683c791 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:10.770904 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-baa8ba58-9f68-4782-b31e-6dac65eb8273 req-a42ac54b-d858-47c2-b897-1c0f3683c791 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.1363332 Nov 08 04:17:10.789529 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] For port 0aae4312-8f40-413f-b687-6b651ec25acd, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101667) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:17:10.794662 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] For port 0aae4312-8f40-413f-b687-6b651ec25acd, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0aae4312-8f40-413f-b687-6b651ec25acd,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101667) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:17:10.819282 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.835045 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363d3627-d171-4590-b0b4-807d92903714 req-1691a5d7-aaf5-439d-8bdd-41a1d79b17f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:10.836616 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-363d3627-d171-4590-b0b4-807d92903714 req-1691a5d7-aaf5-439d-8bdd-41a1d79b17f6 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d23a714c188845279fa19f9c87df4def&device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 1138 time: 0.1048069 Nov 08 04:17:10.873675 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:10.951832 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Routers {'8d32ec67-9649-4b0a-b473-c593c138b81b'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:10.952634 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8d32ec67-9649-4b0a-b473-c593c138b81b'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:10.994517 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b857a99f-1fb7-4b70-ad3b-d02571048233 None None] Pushing event updated for resources: {'Port': ['ID=0aae4312-8f40-413f-b687-6b651ec25acd,revision_number=4']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:11.017030 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363d3627-d171-4590-b0b4-807d92903714 req-e68d4de9-01dc-42d8-adfe-f9ea26f40dce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:11.020485 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-363d3627-d171-4590-b0b4-807d92903714 req-e68d4de9-01dc-42d8-adfe-f9ea26f40dce service neutron] 10.222.0.16 "GET /v2.0/networks?id=92ef9e7b-7c26-4986-b683-d2777b2485f6 HTTP/1.1" status: 200 len: 916 time: 0.1763852 Nov 08 04:17:11.040898 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-f53bfbca-a27d-48c5-87cd-a0d65501f7f6 None None] Provisioning complete for port 0aae4312-8f40-413f-b687-6b651ec25acd triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:11.041359 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f53bfbca-a27d-48c5-87cd-a0d65501f7f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.111376 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] Set router 8d32ec67-9649-4b0a-b473-c593c138b81b gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:11.209989 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-baa8ba58-9f68-4782-b31e-6dac65eb8273 req-7a30dc05-cd57-4864-aa50-3caa4d586553 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1091311 Nov 08 04:17:11.295132 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-363d3627-d171-4590-b0b4-807d92903714 req-68d6b722-0ab4-48f4-9ea5-838501cd9ae7 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e HTTP/1.1" status: 200 len: 1002 time: 0.2557518 Nov 08 04:17:11.329513 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device a996d7df-a0ce-4dc7-821e-00c39172b3f6 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:11.362229 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91208d51-ebdb-439a-b586-0822cecbb812 req-8e0ec14b-1ec3-4b8b-ac3c-5ff371fda35c service neutron] 10.222.0.16 "GET /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6130519 Nov 08 04:17:11.385465 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f53bfbca-a27d-48c5-87cd-a0d65501f7f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.392704 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363d3627-d171-4590-b0b4-807d92903714 req-d83491a6-0366-44df-82d5-b7ceb1445407 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:11.394206 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-363d3627-d171-4590-b0b4-807d92903714 req-d83491a6-0366-44df-82d5-b7ceb1445407 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=80d1402e-d73c-4668-9cb6-646683e6398f HTTP/1.1" status: 200 len: 854 time: 0.0882330 Nov 08 04:17:11.402274 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0aae4312-8f40-413f-b687-6b651ec25acd', 'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'mac_address': 'fa:16:3e:e1:0b:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:06Z', 'updated_at': '2021-11-08T04:17:10Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'subnets': [{'id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:11.434645 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da639a2b-74d8-4880-b9d4-491173c21ba8 None None] The sync data for ids ['8d32ec67-9649-4b0a-b473-c593c138b81b'] in dv-cinder-783643-4-iscsi is: [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0aae4312-8f40-413f-b687-6b651ec25acd', 'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'mac_address': 'fa:16:3e:e1:0b:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:06Z', 'updated_at': '2021-11-08T04:17:10Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'subnets': [{'id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:17:11.442924 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Publish callbacks [] for port, precommit_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.514975 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-f53bfbca-a27d-48c5-87cd-a0d65501f7f6 None None] For port 0aae4312-8f40-413f-b687-6b651ec25acd, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0aae4312-8f40-413f-b687-6b651ec25acd,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:11.525109 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port a996d7df-a0ce-4dc7-821e-00c39172b3f6 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:11.526395 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.538463 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363d3627-d171-4590-b0b4-807d92903714 req-69835c7e-d93a-4ad8-ae1c-5ff697e6c679 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:11.540041 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-363d3627-d171-4590-b0b4-807d92903714 req-69835c7e-d93a-4ad8-ae1c-5ff697e6c679 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=92ef9e7b-7c26-4986-b683-d2777b2485f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1342773 Nov 08 04:17:11.564303 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513'] for port, after_create {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.616620 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f53bfbca-a27d-48c5-87cd-a0d65501f7f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.627587 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '9d8caa52-e595-4dfa-81af-5002d8042e90', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'floating_ip_address': '172.27.2.86', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'port_id': '2abd6ef0-1ecd-43cd-a09b-789090304b54', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 518, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'mac_address': 'fa:16:3e:50:77:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:16:51Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 1, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:11.650188 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.666842 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 is already hosted by enough agents. {{(pid=101666) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:17:11.675606 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.scheduler.base_scheduler [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Resources bound (agent type, host, resource id): {{(pid=101666) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:11.677797 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88af4590-7efe-4570-a304-682f22f8d1d3 None None] The sync data for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi is: [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '9d8caa52-e595-4dfa-81af-5002d8042e90', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'floating_ip_address': '172.27.2.86', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'port_id': '2abd6ef0-1ecd-43cd-a09b-789090304b54', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 518, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'mac_address': 'fa:16:3e:50:77:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:16:51Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 1, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:17:11.680342 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Received port after_create {{(pid=101666) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:17:11.684556 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Pushing event updated for resources: {'Port': ['ID=0cb67928-147b-4619-9679-bd929dadb50d,revision_number=1']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:11.831842 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Attempting to bind port 0cb67928-147b-4619-9679-bd929dadb50d on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:17:11.832211 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Attempting to bind port 0cb67928-147b-4619-9679-bd929dadb50d by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '96d21411-2303-43dc-b36f-5eeb64f10618', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:17:11.832571 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Attempting to bind port 0cb67928-147b-4619-9679-bd929dadb50d on network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:17:11.837309 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-0fb5a6fb-899b-40c6-9f7c-23e19179f177 None None] Provisioning complete for port 0aae4312-8f40-413f-b687-6b651ec25acd triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:11.837682 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-0fb5a6fb-899b-40c6-9f7c-23e19179f177 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.841778 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53bfbca-a27d-48c5-87cd-a0d65501f7f6 None None] Pushing event updated for resources: {'Port': ['ID=0aae4312-8f40-413f-b687-6b651ec25acd,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:11.868631 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 16, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:17:11.869033 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Checking segment: {'id': '96d21411-2303-43dc-b36f-5eeb64f10618', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:17:11.869396 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.869787 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Bound using segment: {'id': '96d21411-2303-43dc-b36f-5eeb64f10618', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:17:11.870276 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Bound port: 0cb67928-147b-4619-9679-bd929dadb50d, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '96d21411-2303-43dc-b36f-5eeb64f10618', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:17:11.870683 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.948082 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:11.957170 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] For port 0cb67928-147b-4619-9679-bd929dadb50d, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:17:11.989288 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec7a0508-f889-4108-8673-4aa0ba9db395 None None] New status for floating IP 9d8caa52-e595-4dfa-81af-5002d8042e90: ACTIVE {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:17:12.001602 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-363d3627-d171-4590-b0b4-807d92903714 req-a26efab4-49f6-42ca-8261-bfb232a57dfc service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4512434 Nov 08 04:17:12.011907 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] For port 0cb67928-147b-4619-9679-bd929dadb50d, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0cb67928-147b-4619-9679-bd929dadb50d,segment=NetworkSegment(96d21411-2303-43dc-b36f-5eeb64f10618),segment_id=96d21411-2303-43dc-b36f-5eeb64f10618)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:17:12.072435 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:12.148543 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Allocated IP 172.27.2.53 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/ec70deab-e8f7-45bb-96f1-847a03824b96) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:17:12.161755 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aedfdf8-6859-4f12-b904-4dd6fc6fc9e1 None None] Pushing event updated for resources: {'Port': ['ID=0cb67928-147b-4619-9679-bd929dadb50d,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:12.169238 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-363d3627-d171-4590-b0b4-807d92903714 req-10caca64-ad68-4753-b27d-a7a2b4d0b2e6 service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1572874 Nov 08 04:17:12.307615 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:12.416734 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470a2071-2ff6-4461-957e-12a9d376fc8d req-fdee5459-74b5-40da-b2e4-12df1fd8250d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:12.424427 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-470a2071-2ff6-4461-957e-12a9d376fc8d req-fdee5459-74b5-40da-b2e4-12df1fd8250d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.1240642 Nov 08 04:17:12.462297 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:12.519126 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-470a2071-2ff6-4461-957e-12a9d376fc8d req-f02ea245-3a02-49ef-8b0f-e31b24da12c0 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0937572 Nov 08 04:17:12.544687 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:17:12.544687 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Pushing event updated for resources: {'Port': ['ID=ec70deab-e8f7-45bb-96f1-847a03824b96,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:12.545306 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:12.548570 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:17:12.634296 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-550a69ac-23df-4eea-9fea-ca7a96231711 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:12.869402 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:13.069114 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-701612', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-688891'] for router, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:13.143939 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09bd9653-0a97-40a7-86f6-8002c639e32a None None] Network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:17:13.214466 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-deb9c1e8-ebaf-4b0b-acf8-3c7a84bfb5a7 None None] Provisioning complete for port 0cb67928-147b-4619-9679-bd929dadb50d triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:13.214930 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-deb9c1e8-ebaf-4b0b-acf8-3c7a84bfb5a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:13.262332 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0cb67928-147b-4619-9679-bd929dadb50d up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:13.277152 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Router 005f8227-4f38-43f7-815b-59ac1a7067a5 is scheduled to L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 with binding_index 1 {{(pid=101664) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 08 04:17:13.383738 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:17:13.407017 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Sync routers for ids ['005f8227-4f38-43f7-815b-59ac1a7067a5'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:17:13.412424 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-deb9c1e8-ebaf-4b0b-acf8-3c7a84bfb5a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:13.417938 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 0cb67928-147b-4619-9679-bd929dadb50d triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:13.418297 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:13.450817 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:13.454690 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-687f4ba0-719d-4c45-b02d-80b6090b6551 admin admin] 10.222.0.21 "POST /v2.0/routers HTTP/1.1" status: 201 len: 918 time: 3.2466252 Nov 08 04:17:13.455171 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57128) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:13.470985 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Routers {'005f8227-4f38-43f7-815b-59ac1a7067a5'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:13.471665 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['005f8227-4f38-43f7-815b-59ac1a7067a5'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:13.538104 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-deb9c1e8-ebaf-4b0b-acf8-3c7a84bfb5a7 None None] For port 0cb67928-147b-4619-9679-bd929dadb50d, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0cb67928-147b-4619-9679-bd929dadb50d,segment=NetworkSegment(96d21411-2303-43dc-b36f-5eeb64f10618),segment_id=96d21411-2303-43dc-b36f-5eeb64f10618)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:13.594346 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-deb9c1e8-ebaf-4b0b-acf8-3c7a84bfb5a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:13.693250 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Set router 005f8227-4f38-43f7-815b-59ac1a7067a5 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:13.715987 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a9a4cf-6728-425f-ac43-8bb729ec922f req-b089b0b3-bd59-4913-b906-8f26cc0a7636 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:13.725948 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-88a9a4cf-6728-425f-ac43-8bb729ec922f req-b089b0b3-bd59-4913-b906-8f26cc0a7636 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0933976 Nov 08 04:17:13.800254 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0aae4312-8f40-413f-b687-6b651ec25acd up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:13.810596 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-88a9a4cf-6728-425f-ac43-8bb729ec922f req-44d2252e-7904-4086-ad75-b701356e449d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0825305 Nov 08 04:17:13.880355 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb9c1e8-ebaf-4b0b-acf8-3c7a84bfb5a7 None None] Pushing event updated for resources: {'Port': ['ID=0cb67928-147b-4619-9679-bd929dadb50d,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:13.952843 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.034937 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-458f07f5-1c5a-4152-9055-85e5ac433a3f None None] Provisioning complete for port 0cb67928-147b-4619-9679-bd929dadb50d triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:14.035303 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-458f07f5-1c5a-4152-9055-85e5ac433a3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.108261 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 0aae4312-8f40-413f-b687-6b651ec25acd triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:14.108641 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.110671 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Allocated IP 172.20.0.1 (40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7/6bbd9ae0-de11-4b7d-a466-be22da39973f/560584d8-1630-4840-bcc5-e1e836772de5) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:17:14.214848 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.230522 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'name': 'tempest-TestShelveInstance-32901558-router', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53'}], 'enable_snat': True}, 'gw_port_id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:10Z', 'updated_at': '2021-11-08T04:17:12Z', 'revision_number': 3, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'gw_port': {'id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:7b:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:11Z', 'updated_at': '2021-11-08T04:17:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:14.263895 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Checking router: 005f8227-4f38-43f7-815b-59ac1a7067a5 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:17:14.264241 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Updating router 005f8227-4f38-43f7-815b-59ac1a7067a5 port ec70deab-e8f7-45bb-96f1-847a03824b96 binding host dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:17:14.290934 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.294925 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.330708 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:17:14.337677 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:14.341285 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:17:14.363349 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Pushing event updated for resources: {'Port': ['ID=560584d8-1630-4840-bcc5-e1e836772de5,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:14.383952 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-703278'] for router_interface, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.560599 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Publish callbacks [] for port, precommit_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.564040 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-51a9cf91-1912-46fe-a68a-aeb8f38a1cac None None] Provisioning complete for port 560584d8-1630-4840-bcc5-e1e836772de5 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:14.564397 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-51a9cf91-1912-46fe-a68a-aeb8f38a1cac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.578306 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.598411 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-51a9cf91-1912-46fe-a68a-aeb8f38a1cac None None] Port 560584d8-1630-4840-bcc5-e1e836772de5 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:17:14.614425 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.664791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Attempting to bind port ec70deab-e8f7-45bb-96f1-847a03824b96 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:17:14.665165 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Attempting to bind port ec70deab-e8f7-45bb-96f1-847a03824b96 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:17:14.665532 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Attempting to bind port ec70deab-e8f7-45bb-96f1-847a03824b96 on network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:17:14.672690 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee044a3a-948e-4471-bc71-faa10feb8fbd None None] Pushing event updated for resources: {'Port': ['ID=ec70deab-e8f7-45bb-96f1-847a03824b96,revision_number=2']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:14.675458 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 16, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:17:14.681187 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Checking segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101666) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:17:14.681187 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.681187 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Bound using segment: {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'} {{(pid=101666) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:17:14.681187 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.managers [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Bound port: ec70deab-e8f7-45bb-96f1-847a03824b96, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9577efe5-3511-40fe-9ebe-e6ea7e63ac49', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4'}}] {{(pid=101666) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:17:14.681187 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.732410 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] For port ec70deab-e8f7-45bb-96f1-847a03824b96, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101666) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:17:14.735765 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] For port ec70deab-e8f7-45bb-96f1-847a03824b96, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=ec70deab-e8f7-45bb-96f1-847a03824b96,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:17:14.746702 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.809444 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.822696 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.871667 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Routers {'005f8227-4f38-43f7-815b-59ac1a7067a5'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:14.872243 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:16:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['005f8227-4f38-43f7-815b-59ac1a7067a5'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:14.890423 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Pushing event updated for resources: {'Port': ['ID=560584d8-1630-4840-bcc5-e1e836772de5,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:14.892977 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530987', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-703418'] for router_interface, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:14.909831 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee044a3a-948e-4471-bc71-faa10feb8fbd None None] Pushing event updated for resources: {'Port': ['ID=ec70deab-e8f7-45bb-96f1-847a03824b96,revision_number=3']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:14.947542 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6f0eb6-2fb3-4e61-8718-51321e8b4120 req-cca542b0-7b23-466f-a900-6c2a3397e530 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:14.949027 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d6f0eb6-2fb3-4e61-8718-51321e8b4120 req-cca542b0-7b23-466f-a900-6c2a3397e530 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0589466 Nov 08 04:17:14.992956 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:17:14.994490 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:14.997163 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] Set router 005f8227-4f38-43f7-815b-59ac1a7067a5 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:15.019978 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d6f0eb6-2fb3-4e61-8718-51321e8b4120 req-34eda9c4-adb5-4446-afb8-933c3eeee834 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0647357 Nov 08 04:17:15.123115 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Router 005f8227-4f38-43f7-815b-59ac1a7067a5 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:17:15.198323 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-303935cd-3dab-4114-8204-54163ca35eff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:15.229259 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'name': 'tempest-TestShelveInstance-32901558-router', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53'}], 'enable_snat': True}, 'gw_port_id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:10Z', 'updated_at': '2021-11-08T04:17:14Z', 'revision_number': 4, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'gw_port': {'id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:7b:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:11Z', 'updated_at': '2021-11-08T04:17:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '560584d8-1630-4840-bcc5-e1e836772de5', 'name': '', 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'mac_address': 'fa:16:3e:f2:4d:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '6bbd9ae0-de11-4b7d-a466-be22da39973f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:13Z', 'updated_at': '2021-11-08T04:17:14Z', 'revision_number': 2, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'subnets': [{'id': '6bbd9ae0-de11-4b7d-a466-be22da39973f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:15.232619 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0cb67928-147b-4619-9679-bd929dadb50d up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:15.284723 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdb57b68-74e2-4cdd-8209-2b0bf3cef83d None None] The sync data for ids ['005f8227-4f38-43f7-815b-59ac1a7067a5'] in dv-cinder-783643-4-iscsi is: [{'id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'name': 'tempest-TestShelveInstance-32901558-router', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53'}], 'enable_snat': True}, 'gw_port_id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:10Z', 'updated_at': '2021-11-08T04:17:14Z', 'revision_number': 4, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'gw_port': {'id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:7b:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:11Z', 'updated_at': '2021-11-08T04:17:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '560584d8-1630-4840-bcc5-e1e836772de5', 'name': '', 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'mac_address': 'fa:16:3e:f2:4d:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '6bbd9ae0-de11-4b7d-a466-be22da39973f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:13Z', 'updated_at': '2021-11-08T04:17:14Z', 'revision_number': 2, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'subnets': [{'id': '6bbd9ae0-de11-4b7d-a466-be22da39973f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:17:15.322724 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 0cb67928-147b-4619-9679-bd929dadb50d triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:15.323088 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:15.357497 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-75a44f90-d5af-4e98-82fc-1690893b82d8 None None] Provisioning complete for port 560584d8-1630-4840-bcc5-e1e836772de5 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:15.357755 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-75a44f90-d5af-4e98-82fc-1690893b82d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:15.404181 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-75a44f90-d5af-4e98-82fc-1690893b82d8 None None] Port 560584d8-1630-4840-bcc5-e1e836772de5 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:17:15.532822 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:17:15.537691 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-2760841a-3298-431d-a4d5-3fc16ccfa8a2 admin admin] 10.222.0.21 "PUT /v2.0/routers/005f8227-4f38-43f7-815b-59ac1a7067a5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0811121 Nov 08 04:17:15.981091 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:16.150212 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cba286b-946c-4a8a-b452-78c20fc4e19a req-17ddabff-e683-46ae-b77c-e3112367fca5 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:16.152582 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cba286b-946c-4a8a-b452-78c20fc4e19a req-17ddabff-e683-46ae-b77c-e3112367fca5 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0594168 Nov 08 04:17:16.216363 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cba286b-946c-4a8a-b452-78c20fc4e19a req-095da2d4-3cf1-45a8-af7e-177eca56248d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0564473 Nov 08 04:17:16.454749 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57154) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:16.462307 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-2cd0f86e-a87e-4278-bff9-08a859a40b86 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1072461123', 'description': 'tempest-secgroup-smoke-1072461123 description', 'project_id': '9e6436a3d5084995840a192763eea4ae'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:16.552319 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2cd0f86e-a87e-4278-bff9-08a859a40b86 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:16.630913 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2cd0f86e-a87e-4278-bff9-08a859a40b86 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:16.682938 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2cd0f86e-a87e-4278-bff9-08a859a40b86 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:16.709851 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cd0f86e-a87e-4278-bff9-08a859a40b86 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event updated for resources: {'SecurityGroup': ['ID=09645d51-409d-4698-ada1-e2a02622f814,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:16.760194 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-2cd0f86e-a87e-4278-bff9-08a859a40b86 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:16.761421 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-2cd0f86e-a87e-4278-bff9-08a859a40b86 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3056579 Nov 08 04:17:16.764339 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57156) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:16.768544 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-dfe92d61-e984-4b9c-ab5a-74f8bab4f488 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Request body: {'security_group_rule': {'security_group_id': '09645d51-409d-4698-ada1-e2a02622f814', 'project_id': '9e6436a3d5084995840a192763eea4ae', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:16.854397 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dfe92d61-e984-4b9c-ab5a-74f8bab4f488 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:16.912446 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dfe92d61-e984-4b9c-ab5a-74f8bab4f488 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:16.964240 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dfe92d61-e984-4b9c-ab5a-74f8bab4f488 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:16.982029 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe92d61-e984-4b9c-ab5a-74f8bab4f488 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b003db04-b7a9-46f3-bb0d-78c96bfb9312,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:17.050544 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-dfe92d61-e984-4b9c-ab5a-74f8bab4f488 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.051828 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-dfe92d61-e984-4b9c-ab5a-74f8bab4f488 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2865591 Nov 08 04:17:17.055009 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57162) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:17.059492 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-c7aab005-a5bc-4f5e-bd0a-2f526445e2f4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Request body: {'security_group_rule': {'security_group_id': '09645d51-409d-4698-ada1-e2a02622f814', 'project_id': '9e6436a3d5084995840a192763eea4ae', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:17.156992 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7aab005-a5bc-4f5e-bd0a-2f526445e2f4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.216510 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7aab005-a5bc-4f5e-bd0a-2f526445e2f4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.227334 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device ec70deab-e8f7-45bb-96f1-847a03824b96 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:17.276405 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port ec70deab-e8f7-45bb-96f1-847a03824b96 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:17.276774 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.283978 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7aab005-a5bc-4f5e-bd0a-2f526445e2f4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.306807 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7aab005-a5bc-4f5e-bd0a-2f526445e2f4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8981f5d1-146b-42b3-be03-ab42eb119c2a,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:17.345692 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5cb063b-5c6b-4438-9459-bde16f52abbc req-1c30c823-a990-4b42-87cf-a5adf390ce77 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:17.347243 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d5cb063b-5c6b-4438-9459-bde16f52abbc req-1c30c823-a990-4b42-87cf-a5adf390ce77 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0577254 Nov 08 04:17:17.364826 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.385451 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] For port ec70deab-e8f7-45bb-96f1-847a03824b96, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=ec70deab-e8f7-45bb-96f1-847a03824b96,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:17.394667 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7aab005-a5bc-4f5e-bd0a-2f526445e2f4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.396897 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-c7aab005-a5bc-4f5e-bd0a-2f526445e2f4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3398926 Nov 08 04:17:17.399196 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57166) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:17.403509 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-3eb12b04-99b0-4817-9fb2-49afc99b5b4b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Request body: {'security_group_rule': {'security_group_id': '09645d51-409d-4698-ada1-e2a02622f814', 'project_id': '9e6436a3d5084995840a192763eea4ae', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:17.410120 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d5cb063b-5c6b-4438-9459-bde16f52abbc req-c59828a2-10c0-4929-a9e2-bfd06e756bff tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0556095 Nov 08 04:17:17.432506 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.479847 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Pushing event updated for resources: {'Port': ['ID=ec70deab-e8f7-45bb-96f1-847a03824b96,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:17.500339 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3eb12b04-99b0-4817-9fb2-49afc99b5b4b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.559917 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3eb12b04-99b0-4817-9fb2-49afc99b5b4b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.603961 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.615565 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3eb12b04-99b0-4817-9fb2-49afc99b5b4b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.634758 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eb12b04-99b0-4817-9fb2-49afc99b5b4b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c67a365c-efdf-40e1-9e3d-a68405bf30a7,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:17.674202 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-3eb12b04-99b0-4817-9fb2-49afc99b5b4b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.675439 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-3eb12b04-99b0-4817-9fb2-49afc99b5b4b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2753177 Nov 08 04:17:17.678016 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57168) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:17.682240 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-80e7110d-58b4-4825-a61b-bc7399a26eb3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Request body: {'security_group_rule': {'security_group_id': '09645d51-409d-4698-ada1-e2a02622f814', 'project_id': '9e6436a3d5084995840a192763eea4ae', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:17.756993 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-80e7110d-58b4-4825-a61b-bc7399a26eb3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.811451 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-80e7110d-58b4-4825-a61b-bc7399a26eb3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.861040 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-80e7110d-58b4-4825-a61b-bc7399a26eb3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.878547 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e7110d-58b4-4825-a61b-bc7399a26eb3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9314f18f-3bb7-4552-b566-2b077efb91a5,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:17.942077 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-80e7110d-58b4-4825-a61b-bc7399a26eb3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:17.943412 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-80e7110d-58b4-4825-a61b-bc7399a26eb3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2644143 Nov 08 04:17:17.946549 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57170) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:17.950861 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-74554018-89b9-4e76-a25e-f67aae1a9525 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Request body: {'security_group_rule': {'security_group_id': '09645d51-409d-4698-ada1-e2a02622f814', 'project_id': '9e6436a3d5084995840a192763eea4ae', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:18.043200 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.securitygroups_db [None req-74554018-89b9-4e76-a25e-f67aae1a9525 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Project 9e6436a3d5084995840a192763eea4ae added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 04:17:18.048331 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-74554018-89b9-4e76-a25e-f67aae1a9525 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:18.104460 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-74554018-89b9-4e76-a25e-f67aae1a9525 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:18.169295 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-74554018-89b9-4e76-a25e-f67aae1a9525 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:18.190328 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74554018-89b9-4e76-a25e-f67aae1a9525 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=95dd7306-c2c5-4138-8034-8db32f13a5d7,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:18.279469 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-74554018-89b9-4e76-a25e-f67aae1a9525 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:18.280752 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-74554018-89b9-4e76-a25e-f67aae1a9525 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3331635 Nov 08 04:17:18.287571 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57176) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:18.291950 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-d5f0d9b8-d1b6-4b6b-84ae-db0925c629e5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Request body: {'security_group_rule': {'security_group_id': '09645d51-409d-4698-ada1-e2a02622f814', 'project_id': '9e6436a3d5084995840a192763eea4ae', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:18.381047 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:18.420985 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.securitygroups_db [None req-d5f0d9b8-d1b6-4b6b-84ae-db0925c629e5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Project 9e6436a3d5084995840a192763eea4ae added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 08 04:17:18.426050 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d5f0d9b8-d1b6-4b6b-84ae-db0925c629e5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:18.484963 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d5f0d9b8-d1b6-4b6b-84ae-db0925c629e5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:18.531732 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b688f817-1177-44cb-8ea2-b08fb3ca7c62 req-903be8b7-b96f-4d3a-8d24-f58e070920a3 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:18.533163 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b688f817-1177-44cb-8ea2-b08fb3ca7c62 req-903be8b7-b96f-4d3a-8d24-f58e070920a3 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0527236 Nov 08 04:17:18.552488 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d5f0d9b8-d1b6-4b6b-84ae-db0925c629e5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770886'] for security_group_rule, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:18.570902 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5f0d9b8-d1b6-4b6b-84ae-db0925c629e5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d6cf3e4-2caa-4d2f-88ed-a1ef486926c5,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:18.595624 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b688f817-1177-44cb-8ea2-b08fb3ca7c62 req-9d2c9aa5-253f-44f7-9682-136c1332f762 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0564456 Nov 08 04:17:18.667828 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d5f0d9b8-d1b6-4b6b-84ae-db0925c629e5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:18.669037 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-d5f0d9b8-d1b6-4b6b-84ae-db0925c629e5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3805315 Nov 08 04:17:19.203327 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device ec70deab-e8f7-45bb-96f1-847a03824b96 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:19.251420 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port ec70deab-e8f7-45bb-96f1-847a03824b96 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:19.251780 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:19.559226 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Sync routers for ids ['005f8227-4f38-43f7-815b-59ac1a7067a5'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:17:19.567265 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Routers {'005f8227-4f38-43f7-815b-59ac1a7067a5'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:19.567869 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:17:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['005f8227-4f38-43f7-815b-59ac1a7067a5'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:19.674421 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Set router 005f8227-4f38-43f7-815b-59ac1a7067a5 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:19.715307 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08a75a8-8b76-4942-8f30-81986d76f6f1 req-20f3ef02-35b9-41ce-becc-798401171fa4 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:19.717208 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d08a75a8-8b76-4942-8f30-81986d76f6f1 req-20f3ef02-35b9-41ce-becc-798401171fa4 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0500529 Nov 08 04:17:19.782040 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d08a75a8-8b76-4942-8f30-81986d76f6f1 req-5908de04-a1f5-4032-a47a-2e6cb1c0fa2e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0583875 Nov 08 04:17:19.874715 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'name': 'tempest-TestShelveInstance-32901558-router', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53'}], 'enable_snat': True}, 'gw_port_id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:10Z', 'updated_at': '2021-11-08T04:17:14Z', 'revision_number': 4, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'gw_port': {'id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:7b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:11Z', 'updated_at': '2021-11-08T04:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '560584d8-1630-4840-bcc5-e1e836772de5', 'name': '', 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'mac_address': 'fa:16:3e:f2:4d:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '6bbd9ae0-de11-4b7d-a466-be22da39973f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:13Z', 'updated_at': '2021-11-08T04:17:14Z', 'revision_number': 2, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'subnets': [{'id': '6bbd9ae0-de11-4b7d-a466-be22da39973f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:19.900496 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Checking router: 005f8227-4f38-43f7-815b-59ac1a7067a5 for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:17:19.900851 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Updating router 005f8227-4f38-43f7-815b-59ac1a7067a5 port 560584d8-1630-4840-bcc5-e1e836772de5 binding host dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 08 04:17:19.925992 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:20.185779 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Publish callbacks [] for port, precommit_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:20.266804 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:20.317446 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6fdf873-ceda-4345-a1e3-037af6b862ba None None] Pushing event updated for resources: {'Port': ['ID=560584d8-1630-4840-bcc5-e1e836772de5,revision_number=3']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:20.371946 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Attempting to bind port 560584d8-1630-4840-bcc5-e1e836772de5 on host dv-cinder-783643-4-iscsi for vnic_type normal with profile {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:17:20.372326 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Attempting to bind port 560584d8-1630-4840-bcc5-e1e836772de5 by drivers openvswitch,hyperv on host dv-cinder-783643-4-iscsi at level 0 using segments [{'id': '96d21411-2303-43dc-b36f-5eeb64f10618', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7'}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:17:20.372677 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Attempting to bind port 560584d8-1630-4840-bcc5-e1e836772de5 on network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:17:20.377751 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Checking agent: {'id': 'a67d000c-ef92-4da0-94e9-f7719d4c2be7', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-783643-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 2, 48), 'started_at': datetime.datetime(2021, 11, 8, 4, 3, 18), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 17, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-783643-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:17:20.378125 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Checking segment: {'id': '96d21411-2303-43dc-b36f-5eeb64f10618', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101667) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:17:20.378676 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:20.379174 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Bound using segment: {'id': '96d21411-2303-43dc-b36f-5eeb64f10618', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7'} {{(pid=101667) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:17:20.379593 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.managers [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Bound port: 560584d8-1630-4840-bcc5-e1e836772de5, host: dv-cinder-783643-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '96d21411-2303-43dc-b36f-5eeb64f10618', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 198, 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7'}}] {{(pid=101667) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:17:20.379972 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:20.457226 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] For port 560584d8-1630-4840-bcc5-e1e836772de5, host dv-cinder-783643-4-iscsi, cleared binding levels {{(pid=101667) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:17:20.460521 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.plugins.ml2.db [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] For port 560584d8-1630-4840-bcc5-e1e836772de5, host dv-cinder-783643-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=560584d8-1630-4840-bcc5-e1e836772de5,segment=NetworkSegment(96d21411-2303-43dc-b36f-5eeb64f10618),segment_id=96d21411-2303-43dc-b36f-5eeb64f10618)] {{(pid=101667) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:17:20.547415 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron_lib.callbacks.manager [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101667) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:20.560247 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8e54fbe4-76e4-41d9-86c1-9b4b2365c3cf None None] Provisioning complete for port 560584d8-1630-4840-bcc5-e1e836772de5 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:20.560805 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8e54fbe4-76e4-41d9-86c1-9b4b2365c3cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:20.612179 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6fdf873-ceda-4345-a1e3-037af6b862ba None None] Pushing event updated for resources: {'Port': ['ID=560584d8-1630-4840-bcc5-e1e836772de5,revision_number=4']} {{(pid=101667) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:20.616564 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Routers {'005f8227-4f38-43f7-815b-59ac1a7067a5'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:20.617202 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:17:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['005f8227-4f38-43f7-815b-59ac1a7067a5'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:20.703001 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8e54fbe4-76e4-41d9-86c1-9b4b2365c3cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:20.771960 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-8e54fbe4-76e4-41d9-86c1-9b4b2365c3cf None None] For port 560584d8-1630-4840-bcc5-e1e836772de5, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=560584d8-1630-4840-bcc5-e1e836772de5,segment=NetworkSegment(96d21411-2303-43dc-b36f-5eeb64f10618),segment_id=96d21411-2303-43dc-b36f-5eeb64f10618)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:20.772341 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] Set router 005f8227-4f38-43f7-815b-59ac1a7067a5 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:20.911778 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e55b86a2-061c-4591-956b-def338b1a2a1 req-7998459d-051b-4d28-a06a-c2014b92e9e9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:20.913308 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e55b86a2-061c-4591-956b-def338b1a2a1 req-7998459d-051b-4d28-a06a-c2014b92e9e9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0576398 Nov 08 04:17:20.926521 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8e54fbe4-76e4-41d9-86c1-9b4b2365c3cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:20.968505 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'name': 'tempest-TestShelveInstance-32901558-router', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53'}], 'enable_snat': True}, 'gw_port_id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:10Z', 'updated_at': '2021-11-08T04:17:14Z', 'revision_number': 4, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'gw_port': {'id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:7b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:11Z', 'updated_at': '2021-11-08T04:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '560584d8-1630-4840-bcc5-e1e836772de5', 'name': '', 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'mac_address': 'fa:16:3e:f2:4d:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '6bbd9ae0-de11-4b7d-a466-be22da39973f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:13Z', 'updated_at': '2021-11-08T04:17:20Z', 'revision_number': 4, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'subnets': [{'id': '6bbd9ae0-de11-4b7d-a466-be22da39973f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:20.981767 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e54fbe4-76e4-41d9-86c1-9b4b2365c3cf None None] Pushing event updated for resources: {'Port': ['ID=560584d8-1630-4840-bcc5-e1e836772de5,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:21.001038 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ec0c8a3-239f-4926-9db2-c9a3d990b9da None None] The sync data for ids ['005f8227-4f38-43f7-815b-59ac1a7067a5'] in dv-cinder-783643-4-iscsi is: [{'id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'name': 'tempest-TestShelveInstance-32901558-router', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53'}], 'enable_snat': True}, 'gw_port_id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:10Z', 'updated_at': '2021-11-08T04:17:14Z', 'revision_number': 4, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'gw_port': {'id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:7b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:11Z', 'updated_at': '2021-11-08T04:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '560584d8-1630-4840-bcc5-e1e836772de5', 'name': '', 'network_id': '40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'mac_address': 'fa:16:3e:f2:4d:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_interface', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '6bbd9ae0-de11-4b7d-a466-be22da39973f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:13Z', 'updated_at': '2021-11-08T04:17:20Z', 'revision_number': 4, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'subnets': [{'id': '6bbd9ae0-de11-4b7d-a466-be22da39973f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:17:21.001423 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e55b86a2-061c-4591-956b-def338b1a2a1 req-e0d59d3d-664f-401d-baa4-dbd709d6412f tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0820518 Nov 08 04:17:21.051310 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-39622cf2-8379-4296-a8c2-aef500246baa None None] Provisioning complete for port 560584d8-1630-4840-bcc5-e1e836772de5 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:21.051680 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-39622cf2-8379-4296-a8c2-aef500246baa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:21.255040 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 560584d8-1630-4840-bcc5-e1e836772de5 up at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:21.308851 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Provisioning complete for port 560584d8-1630-4840-bcc5-e1e836772de5 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:21.309229 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:22.118754 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3fe674c-09c4-49af-85f4-883936326df7 req-a1e1db37-5578-4b3c-a7b1-8ffecf83695b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:22.120326 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b3fe674c-09c4-49af-85f4-883936326df7 req-a1e1db37-5578-4b3c-a7b1-8ffecf83695b tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0509837 Nov 08 04:17:22.179252 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b3fe674c-09c4-49af-85f4-883936326df7 req-dd822919-8e82-4130-bcfc-897d42c27936 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0529623 Nov 08 04:17:23.301968 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9cc15d9-99bd-4a78-935a-6ec1d092dccb req-95725703-86b2-4188-9d67-756cb851dbe9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:23.303674 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c9cc15d9-99bd-4a78-935a-6ec1d092dccb req-95725703-86b2-4188-9d67-756cb851dbe9 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0531945 Nov 08 04:17:23.376065 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c9cc15d9-99bd-4a78-935a-6ec1d092dccb req-95ab277e-aa4a-4bd2-8306-05a9cb13bee3 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0663593 Nov 08 04:17:23.917681 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91216977-bbb7-49be-a540-f458cc384dcb req-56792e5f-b741-452b-8010-9f46e1934a9b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:23.922329 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91216977-bbb7-49be-a540-f458cc384dcb req-56792e5f-b741-452b-8010-9f46e1934a9b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0508561 Nov 08 04:17:23.967108 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91216977-bbb7-49be-a540-f458cc384dcb req-cd225d59-d8c9-438b-993f-9d8adffc31ba tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414364 Nov 08 04:17:24.245013 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:24.497907 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f139bea-d78c-44e4-91f1-b25ae92a88bd req-5171f1b8-5e8c-4e60-aa5b-100575ea60c4 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:24.499384 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2f139bea-d78c-44e4-91f1-b25ae92a88bd req-5171f1b8-5e8c-4e60-aa5b-100575ea60c4 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0479300 Nov 08 04:17:24.559866 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2f139bea-d78c-44e4-91f1-b25ae92a88bd req-6e3a0566-987d-47ed-9419-8880daac697a tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0544801 Nov 08 04:17:25.089367 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de55da8-bad2-4bce-89e6-f46ce4ef5cdb req-368f9532-c3de-40d3-8c1a-2e0d997ef04d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:25.090861 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3de55da8-bad2-4bce-89e6-f46ce4ef5cdb req-368f9532-c3de-40d3-8c1a-2e0d997ef04d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0538452 Nov 08 04:17:25.137047 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3de55da8-bad2-4bce-89e6-f46ce4ef5cdb req-1197e80c-521e-4f36-858a-fb8b6fd67070 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402257 Nov 08 04:17:25.686536 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27d64d73-1059-49d0-b03d-e8e20f0bd62e req-dc2258e5-f203-4c79-9643-42f3f1552a38 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:25.688029 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-27d64d73-1059-49d0-b03d-e8e20f0bd62e req-dc2258e5-f203-4c79-9643-42f3f1552a38 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0517709 Nov 08 04:17:25.736782 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-6ba5a7b9-efd8-4138-8576-2879fe697229 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0467391 Nov 08 04:17:25.752035 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-27d64d73-1059-49d0-b03d-e8e20f0bd62e req-f25c984f-3045-461c-9610-48bd89413b45 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0581727 Nov 08 04:17:25.886438 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-6b9dffb1-44dc-4ee4-a17a-40d445d14c3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:25.887881 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-6b9dffb1-44dc-4ee4-a17a-40d445d14c3c service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 1099 time: 0.0426016 Nov 08 04:17:26.037075 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-376df908-8f8e-4dd9-a872-9a7eed8847e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:26.038563 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-376df908-8f8e-4dd9-a872-9a7eed8847e0 service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0866964 Nov 08 04:17:26.103604 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-c5353c1e-abf5-4a56-ac2e-cc3c684533b1 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=8bfbc5de-2401-404d-81e1-3e4465bb44c8 HTTP/1.1" status: 200 len: 1001 time: 0.0578518 Nov 08 04:17:26.158792 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-7f7e4aca-e72c-42e7-af43-b8a5eaff4461 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:26.160144 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-7f7e4aca-e72c-42e7-af43-b8a5eaff4461 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0478022 Nov 08 04:17:26.211740 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-dcb92621-b737-4a9f-8ca6-9fd912bafd7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:26.213905 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-dcb92621-b737-4a9f-8ca6-9fd912bafd7b service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404878 Nov 08 04:17:26.261429 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb05e13c-f655-48dc-9916-943691c2919f req-4b70465f-fb04-4f70-a6a9-d46e69f1b91d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:26.262962 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fb05e13c-f655-48dc-9916-943691c2919f req-4b70465f-fb04-4f70-a6a9-d46e69f1b91d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0496018 Nov 08 04:17:26.316279 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-f2944730-f013-4e46-ab98-957badee455e service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0938153 Nov 08 04:17:26.317106 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fb05e13c-f655-48dc-9916-943691c2919f req-eca4bd3e-df15-4d51-a750-a352b7a107ae tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482531 Nov 08 04:17:26.411326 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-ce0a09b0-cf2d-404b-881d-3b34f96d25a3 req-43c66a2a-635b-4112-839f-79dbeb9e3f1b service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864780 Nov 08 04:17:26.874748 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-825fbba5-716f-4213-8b2d-07fbd40473de req-80954c0c-b0a5-4d4a-9d93-70cbaa94ab0d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:26.876199 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-825fbba5-716f-4213-8b2d-07fbd40473de req-80954c0c-b0a5-4d4a-9d93-70cbaa94ab0d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0484297 Nov 08 04:17:26.936205 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-825fbba5-716f-4213-8b2d-07fbd40473de req-1247c837-9ac2-4aaa-b669-28a1f00cb003 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0535226 Nov 08 04:17:27.439566 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0c9219f-4fdd-4eb8-8e08-98a8f2479d10 req-4ca34264-d2a8-4c78-bf36-8ff54301c564 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:27.441039 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d0c9219f-4fdd-4eb8-8e08-98a8f2479d10 req-4ca34264-d2a8-4c78-bf36-8ff54301c564 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0504081 Nov 08 04:17:27.490283 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d0c9219f-4fdd-4eb8-8e08-98a8f2479d10 req-4d192486-dac4-408d-bad1-594cadc0aada tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419843 Nov 08 04:17:28.058704 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce72b93e-b538-49f5-b8c4-50c3bb77fcf3 req-a7a6b53c-b12c-4d62-be06-9b2c91c77786 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:28.060139 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce72b93e-b538-49f5-b8c4-50c3bb77fcf3 req-a7a6b53c-b12c-4d62-be06-9b2c91c77786 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0512099 Nov 08 04:17:28.119146 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce72b93e-b538-49f5-b8c4-50c3bb77fcf3 req-7bf8ae48-8133-4a03-8fb8-d33eeea0e2d2 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0532362 Nov 08 04:17:28.615945 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96a01cd-9816-4a28-be7d-2d396111ccfa req-e78d6118-76df-4809-9313-0dff68a11e0a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:28.617409 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c96a01cd-9816-4a28-be7d-2d396111ccfa req-e78d6118-76df-4809-9313-0dff68a11e0a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0500395 Nov 08 04:17:28.666493 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c96a01cd-9816-4a28-be7d-2d396111ccfa req-94f3d0dd-c3c2-4690-8504-03b7b797b79d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414507 Nov 08 04:17:29.243034 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16126f4f-f02a-4eb9-810a-985eae08075f req-88de4284-8558-4efe-b54f-fd90b7fdc2ca tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:29.244502 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-16126f4f-f02a-4eb9-810a-985eae08075f req-88de4284-8558-4efe-b54f-fd90b7fdc2ca tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0545895 Nov 08 04:17:29.303833 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-16126f4f-f02a-4eb9-810a-985eae08075f req-f3829089-e3f4-48a0-9c97-dce02440df6d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&id=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0534701 Nov 08 04:17:29.789669 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f305ab6-23ce-4231-b042-4e5d7b2cfcfa req-3edd6fd3-a6ca-4632-a470-547570b5b57d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:29.791175 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f305ab6-23ce-4231-b042-4e5d7b2cfcfa req-3edd6fd3-a6ca-4632-a470-547570b5b57d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0494671 Nov 08 04:17:29.839678 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f305ab6-23ce-4231-b042-4e5d7b2cfcfa req-97bd5be2-8373-49ac-9c6b-77857f510402 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419543 Nov 08 04:17:30.964578 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96270db-6b73-467e-9c3c-9180188a31f5 req-b13c8bf0-242e-42e2-a2a7-3636591bd6d8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:30.966136 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f96270db-6b73-467e-9c3c-9180188a31f5 req-b13c8bf0-242e-42e2-a2a7-3636591bd6d8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0511703 Nov 08 04:17:31.015730 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f96270db-6b73-467e-9c3c-9180188a31f5 req-f0ea69ca-6ae5-464d-b521-a0604f61798f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436819 Nov 08 04:17:31.970879 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:17:32.134467 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776dd5f7-4479-422c-b10a-68b427bc25f8 req-42c58d2e-5273-4a53-b61c-8d7f323907b5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:32.136372 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-776dd5f7-4479-422c-b10a-68b427bc25f8 req-42c58d2e-5273-4a53-b61c-8d7f323907b5 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0482056 Nov 08 04:17:32.181362 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-776dd5f7-4479-422c-b10a-68b427bc25f8 req-c1ae9690-ed17-41e4-9f73-fc2df8a27ba4 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392652 Nov 08 04:17:33.297377 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9c87b36-4a65-4153-84a6-2529737aa5da req-47e85366-bf4c-4169-8314-734073f19b79 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:33.298835 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c9c87b36-4a65-4153-84a6-2529737aa5da req-47e85366-bf4c-4169-8314-734073f19b79 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0476272 Nov 08 04:17:33.343665 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c9c87b36-4a65-4153-84a6-2529737aa5da req-814e5e64-166b-4606-85ee-a3f95ab76b58 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390911 Nov 08 04:17:34.464335 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d00b97b4-c43e-4a10-8146-50c170587e5e req-af72052f-b67e-45fb-86f8-4c40dfedac72 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:34.465910 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d00b97b4-c43e-4a10-8146-50c170587e5e req-af72052f-b67e-45fb-86f8-4c40dfedac72 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0517697 Nov 08 04:17:34.512259 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d00b97b4-c43e-4a10-8146-50c170587e5e req-488fbeea-4b20-4e58-b482-2bc6f9c8441b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404923 Nov 08 04:17:35.632773 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06219d6b-bf51-4b97-9c70-ffc2ae81edeb req-69a9df82-9e9a-4fd2-bc85-859df68de4eb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:35.634249 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06219d6b-bf51-4b97-9c70-ffc2ae81edeb req-69a9df82-9e9a-4fd2-bc85-859df68de4eb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0521131 Nov 08 04:17:35.679768 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06219d6b-bf51-4b97-9c70-ffc2ae81edeb req-fae1e85c-b78e-49b5-9cb7-0dcea2bae857 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389137 Nov 08 04:17:35.762108 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d29d5bf6-7687-47ca-9dbc-9c6db81cd605 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:17:35.856178 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:35.866910 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'port_id': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'mac_address': 'fa:16:3e:70:81:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 184, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:17:35.902259 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:35.914396 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id d29d5bf6-7687-47ca-9dbc-9c6db81cd605 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:17:35.934203 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:36.003921 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:36.052536 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=6']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:36.184984 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['d29d5bf6-7687-47ca-9dbc-9c6db81cd605'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:17:36.797044 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdcb6ebf-a096-41ca-aeb9-de426f60f892 req-5ca71027-cd53-4191-91c5-ce70f5243c88 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:36.798601 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fdcb6ebf-a096-41ca-aeb9-de426f60f892 req-5ca71027-cd53-4191-91c5-ce70f5243c88 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 945 time: 0.0486360 Nov 08 04:17:36.848484 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fdcb6ebf-a096-41ca-aeb9-de426f60f892 req-0487f3f7-c302-46df-8203-010b832bd0c4 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439479 Nov 08 04:17:37.309862 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-1ddc26e6-bdd3-4de8-8d9b-db6245e7fa88 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1072461123&fields=id&tenant_id=9e6436a3d5084995840a192763eea4ae HTTP/1.1" status: 200 len: 267 time: 0.0430868 Nov 08 04:17:37.414440 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-33831e41-c37f-4fc2-8c4c-b65db3cc805f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:37.415806 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-33831e41-c37f-4fc2-8c4c-b65db3cc805f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/networks?id=6fbc518a-d762-4340-b3c4-10e04086e375 HTTP/1.1" status: 200 len: 809 time: 0.0993376 Nov 08 04:17:37.430654 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-62b5a34f-269b-4c19-b1fb-aa46a23819f5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/quotas/9e6436a3d5084995840a192763eea4ae HTTP/1.1" status: 200 len: 375 time: 0.0086920 Nov 08 04:17:37.483598 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-3bea6470-cd3b-46fe-8bc6-eb6d0a3352b9 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=9e6436a3d5084995840a192763eea4ae&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0472775 Nov 08 04:17:37.580843 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-eeb345a7-f48f-4026-8428-0487a6733284 service neutron] 10.222.0.21 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860965 Nov 08 04:17:37.676472 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a4e63080-96c2-4d0b-8d86-0aac0f3cfd63 service neutron] 10.222.0.21 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893238 Nov 08 04:17:37.778699 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d29d5bf6-7687-47ca-9dbc-9c6db81cd605 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:37.824802 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:37.825163 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:37.987008 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efda4b8e-2530-447c-94e0-e9427fde9a06 req-40983cfa-346c-4fd9-a621-815f7f45d189 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:37.988447 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-efda4b8e-2530-447c-94e0-e9427fde9a06 req-40983cfa-346c-4fd9-a621-815f7f45d189 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 945 time: 0.0603113 Nov 08 04:17:38.024232 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:38.036014 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-efda4b8e-2530-447c-94e0-e9427fde9a06 req-076142b0-a4e6-4491-be8d-2845518d9e31 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409453 Nov 08 04:17:38.047208 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:17:38.061117 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e29441d0-65c6-4caa-8739-e64de4c8c536" -d '{"events": [{"server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "name": "network-vif-plugged", "status": "completed", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:17:38.061560 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:38.085325 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:17:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3266f718-549d-4226-869b-8042ac543266 x-openstack-request-id: req-3266f718-549d-4226-869b-8042ac543266 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:17:38.085617 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "name": "network-vif-plugged", "status": "completed", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:17:38.085890 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-3266f718-549d-4226-869b-8042ac543266 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:17:38.086281 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'code': 200} Nov 08 04:17:38.146585 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:38.195757 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=7']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:38.255664 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ddacc028-2ba3-4634-9154-3080c40e7ec0 req-eac05e88-0368-4b84-8c99-67432591d0b9 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 210 time: 0.0291574 Nov 08 04:17:39.171320 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b89760f-e9c9-4f54-a09b-7532ac87fae9 req-700d0b66-e5a3-4b26-8c70-25e1969499ce tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:39.172833 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4b89760f-e9c9-4f54-a09b-7532ac87fae9 req-700d0b66-e5a3-4b26-8c70-25e1969499ce tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0586741 Nov 08 04:17:39.247508 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4b89760f-e9c9-4f54-a09b-7532ac87fae9 req-92d4d641-6b3f-42bf-b2b5-6c8b5817eb1c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0599573 Nov 08 04:17:39.383859 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c1eee0d4-37bc-4565-80b5-49e87c3b86d8 req-fb94a906-8c31-4580-96d9-9c304b59a175 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 210 time: 0.0530074 Nov 08 04:17:40.379629 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d3ffc62-d413-4901-a6ce-41d22bcc88c2 req-92d81c90-49c6-42f6-ac36-b3e6a36f5c30 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:40.381297 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2d3ffc62-d413-4901-a6ce-41d22bcc88c2 req-92d81c90-49c6-42f6-ac36-b3e6a36f5c30 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0701137 Nov 08 04:17:40.446335 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2d3ffc62-d413-4901-a6ce-41d22bcc88c2 req-2ff849e2-ab3a-44f0-90f2-d1788c6d1b34 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566199 Nov 08 04:17:40.523461 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1d0cb31b-ccba-4474-b1fd-c31b90909cc1 req-24f32627-d20e-40b9-baa8-79b224e197a0 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 210 time: 0.0551996 Nov 08 04:17:40.632217 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-c6587dfd-48e7-49bb-a273-f0498283ea04 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:40.634856 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-c6587dfd-48e7-49bb-a273-f0498283ea04 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.16 "GET /v2.0/networks?id=6fbc518a-d762-4340-b3c4-10e04086e375 HTTP/1.1" status: 200 len: 809 time: 0.1649184 Nov 08 04:17:40.751342 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-0ed8e62d-1390-432e-8226-77069890ae08 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9e6436a3d5084995840a192763eea4ae HTTP/1.1" status: 200 len: 380 time: 0.0680904 Nov 08 04:17:40.781143 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Request body: {'port': {'device_id': '29ef3278-30cd-487b-b434-61021d6472ec', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'admin_state_up': True, 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'security_groups': ['09645d51-409d-4698-ada1-e2a02622f814']}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:40.969590 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Made reservation on behalf of 9e6436a3d5084995840a192763eea4ae for: {'port': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:17:40.973612 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:41.133655 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Allocated IP 172.20.0.9 (6fbc518a-d762-4340-b3c4-10e04086e375/cde96b9f-aad6-4299-909d-9e2c0a335515/1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:17:41.315709 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:41.387891 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:41.436264 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Network 6fbc518a-d762-4340-b3c4-10e04086e375 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:17:41.439450 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:41.445656 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:17:41.477056 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event updated for resources: {'Port': ['ID=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:41.488787 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.489137 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.489477 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.489807 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.490131 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.490455 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.490810 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.491122 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.491442 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.491842 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.492162 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.492474 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:17:41.522632 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:41.526398 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:41.613999 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-5c950d0d-2272-4323-b777-315715b7f973 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8382003 Nov 08 04:17:41.644583 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Request body: {'port': {'device_id': '29ef3278-30cd-487b-b434-61021d6472ec', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:41.741338 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:41.750040 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a0f0972-ef25-472f-bd5e-3fb2ae88b2a5 req-d24aea5e-a37c-4e7d-863f-70702a31b2a6 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:41.753632 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9a0f0972-ef25-472f-bd5e-3fb2ae88b2a5 req-d24aea5e-a37c-4e7d-863f-70702a31b2a6 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.1524594 Nov 08 04:17:41.778567 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79211ed-77bc-4f75-bbd8-1533e49be78b req-67ca2952-ccb0-4fb9-a0a2-85d6c6f08fdb tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:41.778567 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c79211ed-77bc-4f75-bbd8-1533e49be78b req-67ca2952-ccb0-4fb9-a0a2-85d6c6f08fdb tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 931 time: 0.1125126 Nov 08 04:17:41.812075 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-4ad4e8e9-5c4f-4936-8941-fac81f2519c8 None None] Provisioning complete for port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:41.812738 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-4ad4e8e9-5c4f-4936-8941-fac81f2519c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:41.851527 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-4ad4e8e9-5c4f-4936-8941-fac81f2519c8 None None] Port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:17:41.870990 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9a0f0972-ef25-472f-bd5e-3fb2ae88b2a5 req-4bbe4494-98ca-4b0c-8200-a9e26918749d tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1108491 Nov 08 04:17:41.879902 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c79211ed-77bc-4f75-bbd8-1533e49be78b req-d74b845e-ff31-4682-bb75-e0fa97ca064c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0934725 Nov 08 04:17:42.056881 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a {{(pid=101664) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:17:42.064745 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:42.077153 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.provisioning_blocks [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Transition to ACTIVE for port object 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a will not be triggered until provisioned by entity L2. {{(pid=101664) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:17:42.220400 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:42.272699 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Pushing event updated for resources: {'Port': ['ID=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:42.343337 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Attempting to bind port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:17:42.343668 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Attempting to bind port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'}] {{(pid=101664) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:17:42.344027 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Attempting to bind port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a on network 6fbc518a-d762-4340-b3c4-10e04086e375 {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:17:42.348684 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a on network 6fbc518a-d762-4340-b3c4-10e04086e375 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:17:42.349038 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Attempting to bind port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a on network 6fbc518a-d762-4340-b3c4-10e04086e375 {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:17:42.354353 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 17, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:17:42.354720 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Checking segment: {'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:17:42.355102 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Bound using segment: {'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'} {{(pid=101664) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:17:42.355532 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.managers [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Bound port: 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3195749d-d797-4105-b176-934eef1ae577', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 190, 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375'}}] {{(pid=101664) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:17:42.355887 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:42.427714 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] For port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host hv-cinder-78364, cleared binding levels {{(pid=101664) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:17:42.431043 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] For port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101664) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:17:42.473457 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:42.522475 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:42.523408 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:42.524744 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] 10.222.0.16 "PUT /v2.0/ports/1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a HTTP/1.1" status: 200 len: 1093 time: 0.8911717 Nov 08 04:17:42.525218 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:17:42.527688 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d" -d '{"events": [{"name": "network-changed", "server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:17:42.561067 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5db805d-d7e0-42e9-b639-c4df9b81938c service neutron] Pushing event updated for resources: {'Port': ['ID=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,revision_number=3']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:42.644372 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-50a99297-79eb-481d-8817-ae259f7fd157 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:42.698441 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:17:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5de21db4-e1f6-460a-8bea-8e89101a1a07 x-openstack-request-id: req-5de21db4-e1f6-460a-8bea-8e89101a1a07 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:17:42.699061 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:17:42.699061 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-5de21db4-e1f6-460a-8bea-8e89101a1a07 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:17:42.699441 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'status': 'completed', 'code': 200} Nov 08 04:17:42.714323 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-6d983a0a-723a-4c64-9d22-ac4e151cefba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:42.715886 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-6d983a0a-723a-4c64-9d22-ac4e151cefba service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=9e6436a3d5084995840a192763eea4ae&device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 1096 time: 0.0564115 Nov 08 04:17:42.774581 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-3c65d29d-613a-4013-bdf6-67ff519c4012 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a HTTP/1.1" status: 200 len: 217 time: 0.0423620 Nov 08 04:17:42.832228 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-28d80fb5-64c0-43db-af2f-0a0b70a25ea0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:42.836610 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-28d80fb5-64c0-43db-af2f-0a0b70a25ea0 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cde96b9f-aad6-4299-909d-9e2c0a335515 HTTP/1.1" status: 200 len: 848 time: 0.0538282 Nov 08 04:17:42.893371 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-d2df5d2e-f77a-438b-b43e-58ef8f306446 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:42.895533 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-d2df5d2e-f77a-438b-b43e-58ef8f306446 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6fbc518a-d762-4340-b3c4-10e04086e375&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0498576 Nov 08 04:17:43.045387 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-dbb525e1-a9b9-42e7-8922-3d51978c0726 service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1380286 Nov 08 04:17:43.066420 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e587e9d-7ede-437a-ac93-3b7dd3cc8c88 req-c9b6ea57-916b-4489-b7ca-17541ea7e7ef tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:43.075711 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2e587e9d-7ede-437a-ac93-3b7dd3cc8c88 req-c9b6ea57-916b-4489-b7ca-17541ea7e7ef tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.1095107 Nov 08 04:17:43.095413 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e73f62-a17e-4a00-80f8-daaf5f7a8c9e req-8ec74f76-64e3-4886-ae86-6a7d8d846222 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:43.102840 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-33e73f62-a17e-4a00-80f8-daaf5f7a8c9e req-8ec74f76-64e3-4886-ae86-6a7d8d846222 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0978756 Nov 08 04:17:43.180193 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-07ed7293-eb2e-45d3-bf73-605aee8fc9ad req-79fec1db-af07-43ac-b37a-b0b4e2d7d8b9 service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1189485 Nov 08 04:17:43.198311 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2e587e9d-7ede-437a-ac93-3b7dd3cc8c88 req-4806d659-aa3b-4a82-8d46-60caebfa111e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1214535 Nov 08 04:17:43.219791 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-33e73f62-a17e-4a00-80f8-daaf5f7a8c9e req-46cdb811-1d9e-4789-b6c4-ffcf18c0494e tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1158216 Nov 08 04:17:43.441636 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-13faeeec-d3f8-4116-a372-35ffa998cad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:43.443133 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-13faeeec-d3f8-4116-a372-35ffa998cad3 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=9e6436a3d5084995840a192763eea4ae&device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 1096 time: 0.0500269 Nov 08 04:17:43.542759 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-8bb3cb1b-fcf7-4719-a612-a0572ad543db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:43.544637 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-8bb3cb1b-fcf7-4719-a612-a0572ad543db service neutron] 10.222.0.16 "GET /v2.0/networks?id=6fbc518a-d762-4340-b3c4-10e04086e375 HTTP/1.1" status: 200 len: 910 time: 0.0915504 Nov 08 04:17:43.599302 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-7ec30204-6f64-4636-b5af-47721d0e3b8b service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a HTTP/1.1" status: 200 len: 217 time: 0.0403666 Nov 08 04:17:43.659953 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-f1d9e82e-477e-4e2b-8c24-1f0d0b0c8df4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:43.661321 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-f1d9e82e-477e-4e2b-8c24-1f0d0b0c8df4 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cde96b9f-aad6-4299-909d-9e2c0a335515 HTTP/1.1" status: 200 len: 848 time: 0.0521421 Nov 08 04:17:43.722453 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-148f2d22-44d4-48e8-8b1f-110607b67882 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:43.725559 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-148f2d22-44d4-48e8-8b1f-110607b67882 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6fbc518a-d762-4340-b3c4-10e04086e375&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0533261 Nov 08 04:17:43.840547 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-669af9a3-1b0b-4089-9f92-1eb66f809a86 service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1055202 Nov 08 04:17:43.942656 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-9bc5f1c9-65c2-4ba5-9b48-3cc11bc5343d req-464f4a84-adc4-44f8-84a1-69d750abcee1 service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0931005 Nov 08 04:17:44.362872 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe3bb66-73ac-41b5-891e-70eeac8b1fdc req-10fdf59c-d045-478c-9f87-406c04186dd3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:44.364343 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bfe3bb66-73ac-41b5-891e-70eeac8b1fdc req-10fdf59c-d045-478c-9f87-406c04186dd3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0867674 Nov 08 04:17:44.379757 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd95cf6a-0c74-45b8-bc47-54a266e36465 req-c05a947f-26a0-4947-a8e0-e813567399d1 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:44.381192 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dd95cf6a-0c74-45b8-bc47-54a266e36465 req-c05a947f-26a0-4947-a8e0-e813567399d1 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0775084 Nov 08 04:17:44.455206 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bfe3bb66-73ac-41b5-891e-70eeac8b1fdc req-5c027d54-229e-4177-864c-76c82fae33b3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0835955 Nov 08 04:17:44.459765 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dd95cf6a-0c74-45b8-bc47-54a266e36465 req-756d6b3c-e90a-411e-bba4-191e36f5c2dc tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0715244 Nov 08 04:17:45.124551 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9ee7751f-3057-4db2-b5b1-95ea0ff1df5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:45.644548 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-820aa93c-291f-4e85-9110-f651d41b4981 req-7777f59b-bc5d-4744-995e-c9ee3ad247d3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:45.647178 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-820aa93c-291f-4e85-9110-f651d41b4981 req-7777f59b-bc5d-4744-995e-c9ee3ad247d3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0905044 Nov 08 04:17:45.681050 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47e19545-844c-4da8-9af4-1003db0a896a req-5931aa30-2ee3-4a45-ba04-56edee6c0d3f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:45.692182 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-47e19545-844c-4da8-9af4-1003db0a896a req-5931aa30-2ee3-4a45-ba04-56edee6c0d3f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.1036208 Nov 08 04:17:45.765688 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-820aa93c-291f-4e85-9110-f651d41b4981 req-8644ef42-d8e6-46ce-8d60-e33bdee7f611 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1084306 Nov 08 04:17:45.773437 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-47e19545-844c-4da8-9af4-1003db0a896a req-3a05a163-4d09-40bf-849a-d61fcb01b81f tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0695808 Nov 08 04:17:45.974468 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:46.950585 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c20ab22-aa3e-4d94-ad16-61f8f9e1a447 req-9ce983be-119e-4108-97c8-853f381ba901 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:46.951993 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2c20ab22-aa3e-4d94-ad16-61f8f9e1a447 req-9ce983be-119e-4108-97c8-853f381ba901 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0822241 Nov 08 04:17:46.960532 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51558714-a5f5-4322-8283-a5b00a5dbbff req-b42ebb48-50fb-4d2f-9738-96e8c1340436 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:46.962040 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51558714-a5f5-4322-8283-a5b00a5dbbff req-b42ebb48-50fb-4d2f-9738-96e8c1340436 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0828679 Nov 08 04:17:47.040465 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2c20ab22-aa3e-4d94-ad16-61f8f9e1a447 req-0c44a13b-243b-4d57-9a09-af13d52b4d90 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0774035 Nov 08 04:17:47.046096 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51558714-a5f5-4322-8283-a5b00a5dbbff req-0dadd328-a4a0-4607-b070-2d7ad63e3eff tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0750539 Nov 08 04:17:47.604245 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:48.231611 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b192d55f-176e-4e3d-a33c-b912c7e4cd3d req-1614723a-39f2-459b-843a-e61568de03d7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:48.233533 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b192d55f-176e-4e3d-a33c-b912c7e4cd3d req-1614723a-39f2-459b-843a-e61568de03d7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.1012790 Nov 08 04:17:48.256485 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85cefd97-9a08-4d1d-b53d-b2a0c102d8be req-3fddc353-3187-485c-a8c4-ae3260ca5c16 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:48.259089 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85cefd97-9a08-4d1d-b53d-b2a0c102d8be req-3fddc353-3187-485c-a8c4-ae3260ca5c16 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0845137 Nov 08 04:17:48.332195 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b192d55f-176e-4e3d-a33c-b912c7e4cd3d req-b470a337-fc19-47ba-89a1-225fa3e4fbad tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0909786 Nov 08 04:17:48.349703 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85cefd97-9a08-4d1d-b53d-b2a0c102d8be req-9774dfa4-c260-4093-881e-83425f0e5e28 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0808177 Nov 08 04:17:48.372026 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:49.504957 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a73b56c-f60f-426e-b1d0-2d3d986c8acc req-7a9f2293-12fd-46e6-ab6e-b3115981d374 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:49.507666 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3a73b56c-f60f-426e-b1d0-2d3d986c8acc req-7a9f2293-12fd-46e6-ab6e-b3115981d374 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0927746 Nov 08 04:17:49.527844 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce015202-980f-4504-b936-bc193f0ee7bb req-fd14ebc5-4d4f-4b5e-8a21-52716813566c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:49.529634 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce015202-980f-4504-b936-bc193f0ee7bb req-fd14ebc5-4d4f-4b5e-8a21-52716813566c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.1015868 Nov 08 04:17:49.594847 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3a73b56c-f60f-426e-b1d0-2d3d986c8acc req-87247369-9a6e-4730-92ef-e845dfa4c7f9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0795755 Nov 08 04:17:49.625017 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce015202-980f-4504-b936-bc193f0ee7bb req-d56aa963-cabe-4c99-8532-7a7a8feb008b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0868435 Nov 08 04:17:50.295411 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be7724a-fe3a-49bd-b62e-433dba43b1e5 req-2ac0c2d4-465f-4cb3-aca6-51f7bf5f09bb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:50.296855 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4be7724a-fe3a-49bd-b62e-433dba43b1e5 req-2ac0c2d4-465f-4cb3-aca6-51f7bf5f09bb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 946 time: 0.0479302 Nov 08 04:17:50.347890 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4be7724a-fe3a-49bd-b62e-433dba43b1e5 req-029b237d-285a-4357-a4e3-53449043927d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452802 Nov 08 04:17:50.743518 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-804e4ee0-bc1f-47f7-93f3-8359170138e1 req-917546d9-d4bf-4116-a729-4d6a9d21daf8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:50.745005 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-804e4ee0-bc1f-47f7-93f3-8359170138e1 req-917546d9-d4bf-4116-a729-4d6a9d21daf8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0722108 Nov 08 04:17:50.775203 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a8925b-c04e-44c8-a7ec-082d991cdbf8 req-31e8fa84-18a0-43f4-aaed-618b0f721121 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:50.777163 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e4a8925b-c04e-44c8-a7ec-082d991cdbf8 req-31e8fa84-18a0-43f4-aaed-618b0f721121 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0763845 Nov 08 04:17:50.815146 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-804e4ee0-bc1f-47f7-93f3-8359170138e1 req-e891c29b-c1ae-4449-b8ab-a4f4bfc7d5e4 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0640583 Nov 08 04:17:50.844765 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e4a8925b-c04e-44c8-a7ec-082d991cdbf8 req-bc798895-05be-4a62-b3ab-98dfb6475724 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0572009 Nov 08 04:17:50.992118 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-d12a8bd8-3bf1-4614-8b63-961698472b55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:50.993583 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-d12a8bd8-3bf1-4614-8b63-961698472b55 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 1099 time: 0.0444279 Nov 08 04:17:51.082456 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-b21090ba-5401-4769-bfe9-a4e025130093 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:51.083887 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-b21090ba-5401-4769-bfe9-a4e025130093 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 918 time: 0.0817704 Nov 08 04:17:51.157953 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-e2cc60d3-b59f-4245-a6c7-87f09c930707 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605 HTTP/1.1" status: 200 len: 1001 time: 0.0603092 Nov 08 04:17:51.206859 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-0f6eb207-d611-4454-9217-45859bceb201 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:51.208235 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-0f6eb207-d611-4454-9217-45859bceb201 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.0419736 Nov 08 04:17:51.256323 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-67065423-55ce-4d2b-a3f3-7ec397f68d67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:51.257716 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-67065423-55ce-4d2b-a3f3-7ec397f68d67 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0378840 Nov 08 04:17:51.348908 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-8616c4f1-e71e-4a91-b2a6-a8809afa4eea service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808768 Nov 08 04:17:51.440529 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-b12ef73c-fc4b-4ab0-91b2-531f782a9b67 req-bd3af9c2-904f-422e-870b-fd7d25a8b0b1 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814238 Nov 08 04:17:51.470291 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a702e7-db59-48f6-8c6f-e91c1281e4ea req-3e35c449-f7b7-41e2-868f-79fc5d112598 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:51.471868 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b5a702e7-db59-48f6-8c6f-e91c1281e4ea req-3e35c449-f7b7-41e2-868f-79fc5d112598 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 946 time: 0.0502918 Nov 08 04:17:51.520125 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b5a702e7-db59-48f6-8c6f-e91c1281e4ea req-3610c4bf-720c-46ae-bdf3-35163d79409c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421369 Nov 08 04:17:51.878311 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:17:51.967348 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49908df9-727b-402e-9ec2-c41e0fe49530 req-c20b2343-fcc3-4fb0-bedb-a5a9b9e7ed68 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:51.968818 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-49908df9-727b-402e-9ec2-c41e0fe49530 req-c20b2343-fcc3-4fb0-bedb-a5a9b9e7ed68 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0776632 Nov 08 04:17:51.981214 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30d25fc2-5c39-4ed2-ae3b-a0beb9d166ea req-8d278dfd-dc93-44c6-80fe-967bdd3b37c6 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:51.982704 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-30d25fc2-5c39-4ed2-ae3b-a0beb9d166ea req-8d278dfd-dc93-44c6-80fe-967bdd3b37c6 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0640759 Nov 08 04:17:51.986059 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:51.997944 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'port_id': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'mac_address': 'fa:16:3e:be:a3:b5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:17:52.039120 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:52.050898 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-49908df9-727b-402e-9ec2-c41e0fe49530 req-da13a1ba-8cb0-404d-9994-b1e679d8f2ac tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0669668 Nov 08 04:17:52.051626 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:17:52.064843 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-30d25fc2-5c39-4ed2-ae3b-a0beb9d166ea req-d434fb49-8e76-4563-9dd3-c2e4e0f15e16 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0742776 Nov 08 04:17:52.074831 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:52.136083 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:52.182971 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:52.495237 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-f44acdc8-28df-4133-a47a-3c1312987140 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:52.496597 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-f44acdc8-28df-4133-a47a-3c1312987140 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 946 time: 0.0523586 Nov 08 04:17:52.547214 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:17:52.597100 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Deleting port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:17:52.597688 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:52.644443 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-030edccc-c615-496b-9159-c985a6d7bd38 req-e1199cb6-45f9-4df6-8927-15109cd6f0c1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:52.645921 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-030edccc-c615-496b-9159-c985a6d7bd38 req-e1199cb6-45f9-4df6-8927-15109cd6f0c1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 946 time: 0.0561106 Nov 08 04:17:52.700667 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-030edccc-c615-496b-9159-c985a6d7bd38 req-debee11d-9ee3-48c0-b3cc-dcafc9ca1643 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469515 Nov 08 04:17:52.705653 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] For port 8bfbc5de-2401-404d-81e1-3e4465bb44c8, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=8bfbc5de-2401-404d-81e1-3e4465bb44c8,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:52.705991 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:52.921528 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:52.921879 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:52.922195 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.l3_db [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Floating IP a902f47b-ca98-4cce-a6ab-f1dcc615bfa4 disassociated. External IP: 172.27.2.57, port: 8bfbc5de-2401-404d-81e1-3e4465bb44c8. Nov 08 04:17:52.922572 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Calling delete_port for 8bfbc5de-2401-404d-81e1-3e4465bb44c8 owned by compute:nova {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:17:53.090187 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:53.119526 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event deleted for resources: {'Port': ['ID=8bfbc5de-2401-404d-81e1-3e4465bb44c8,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:53.216922 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce8abd5-dd00-4d1b-aeb0-72e88fb491fb req-61241718-b28a-4c72-b56e-dce50971b1fc tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:53.218302 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cce8abd5-dd00-4d1b-aeb0-72e88fb491fb req-61241718-b28a-4c72-b56e-dce50971b1fc tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0918655 Nov 08 04:17:53.226414 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e50f1795-b84f-466c-86d2-5829069f853c req-8fcc4bc0-f4c8-46fc-b28b-14adb382d8a8 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:53.227808 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e50f1795-b84f-466c-86d2-5829069f853c req-8fcc4bc0-f4c8-46fc-b28b-14adb382d8a8 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 944 time: 0.0859275 Nov 08 04:17:53.234168 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Router 8aa2c265-b728-4ac3-97de-f276d80d2037 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:17:53.298786 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cce8abd5-dd00-4d1b-aeb0-72e88fb491fb req-f7e1894d-bff9-46f2-933f-23b597327bdb tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0699971 Nov 08 04:17:53.303555 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e50f1795-b84f-466c-86d2-5829069f853c req-26fa15e4-7785-43a2-8c45-ac5ff94e973b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0680084 Nov 08 04:17:53.338687 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:17:53.348668 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] Sync routers for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:17:53.360806 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:53.361573 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:17:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:53.377030 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] No DVR routers for this DVR port 8bfbc5de-2401-404d-81e1-3e4465bb44c8 on host hv-cinder-78364 {{(pid=101664) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:17:53.379470 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:53.382702 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-1b8c8d66-c5da-49aa-b7d8-3d75d65bc013 req-387b7f75-f666-42ab-a416-3e34ddc70637 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "DELETE /v2.0/ports/8bfbc5de-2401-404d-81e1-3e4465bb44c8 HTTP/1.1" status: 204 len: 173 time: 0.8791275 Nov 08 04:17:53.383133 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'name': 'network-vif-deleted', 'tag': '8bfbc5de-2401-404d-81e1-3e4465bb44c8'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:17:53.385875 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a404eab6-2f93-48a5-968f-60d5984450c1" -d '{"events": [{"server_uuid": "e1b4ed4d-2888-42c9-bb24-200f03c9efe0", "name": "network-vif-deleted", "tag": "8bfbc5de-2401-404d-81e1-3e4465bb44c8"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:17:53.422700 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:17:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-53d300d0-e084-4147-8d57-e408c2fc0a8b x-openstack-request-id: req-53d300d0-e084-4147-8d57-e408c2fc0a8b {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:17:53.423229 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e1b4ed4d-2888-42c9-bb24-200f03c9efe0", "name": "network-vif-deleted", "tag": "8bfbc5de-2401-404d-81e1-3e4465bb44c8", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:17:53.423480 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-53d300d0-e084-4147-8d57-e408c2fc0a8b {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:17:53.423875 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e1b4ed4d-2888-42c9-bb24-200f03c9efe0', 'name': 'network-vif-deleted', 'tag': '8bfbc5de-2401-404d-81e1-3e4465bb44c8', 'status': 'completed', 'code': 200} Nov 08 04:17:53.467679 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:53.682800 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:53.709074 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] Checking router: 8aa2c265-b728-4ac3-97de-f276d80d2037 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:17:53.717557 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:53.718162 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:17:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:53.809158 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-548949ba-0eae-4a6e-af76-d9abe387c5cd req-889e336f-7243-43f4-b355-be113a1fe0c8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 210 time: 0.0273468 Nov 08 04:17:53.830811 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:17:53.895796 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:17:54.045235 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:17:54.049254 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:17:54.049618 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:54.096525 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:54.125166 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f68b61ee-8deb-43ad-a45c-cca7634a27ca None None] The sync data for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi is: [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:17:54.169339 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:54.202184 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:17:54.204478 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3d48aa6d-8e44-400b-a860-eb9306fc7a82" -d '{"events": [{"server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "name": "network-vif-plugged", "status": "completed", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:17:54.218108 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:54.245189 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:17:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cf89abb4-69e0-4ff7-803b-d8228e3b462a x-openstack-request-id: req-cf89abb4-69e0-4ff7-803b-d8228e3b462a {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:17:54.245473 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "name": "network-vif-plugged", "status": "completed", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:17:54.245770 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-cf89abb4-69e0-4ff7-803b-d8228e3b462a {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:17:54.246160 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'code': 200} Nov 08 04:17:54.249549 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:54.267040 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:54.267849 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d29d5bf6-7687-47ca-9dbc-9c6db81cd605 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:17:54.392253 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:54.395167 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:54.423234 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57077db1-b402-4bd4-858c-11a112d29c5a None None] New status for floating IP a902f47b-ca98-4cce-a6ab-f1dcc615bfa4: DOWN {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:17:54.454267 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:17:54.505812 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a8f6b3-4b50-4eb6-961f-2b765da9ece8 req-72d4b188-eaf6-408c-b50e-5d990a0df31e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:54.507413 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31a8f6b3-4b50-4eb6-961f-2b765da9ece8 req-72d4b188-eaf6-408c-b50e-5d990a0df31e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 946 time: 0.0903046 Nov 08 04:17:54.515742 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2822db11-b066-46a7-8e1c-d8b9b91bafa7 req-4421dfc7-5696-42b4-9ab8-4fdfd254a37f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:54.518568 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:54.523738 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2822db11-b066-46a7-8e1c-d8b9b91bafa7 req-4421dfc7-5696-42b4-9ab8-4fdfd254a37f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.1163011 Nov 08 04:17:54.572014 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=8']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:54.608650 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31a8f6b3-4b50-4eb6-961f-2b765da9ece8 req-c3260711-56b0-49a4-80c5-5dbd52329d09 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0763402 Nov 08 04:17:54.612676 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2822db11-b066-46a7-8e1c-d8b9b91bafa7 req-72ea2bf3-190c-4ee7-8284-f652ae82044e tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0877295 Nov 08 04:17:54.718947 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73c8eef-6761-4403-b5b1-e7ff916ce416 req-24fe5404-289d-4060-97ea-3be99a6cf206 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:54.720471 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-b73c8eef-6761-4403-b5b1-e7ff916ce416 req-24fe5404-289d-4060-97ea-3be99a6cf206 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 1098 time: 0.0461645 Nov 08 04:17:54.784158 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-b73c8eef-6761-4403-b5b1-e7ff916ce416 req-b3f0339c-62db-4566-b076-25d2b9355f07 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427170 Nov 08 04:17:54.913737 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3b3c6f48-2a08-4127-b57b-cbf8b69e48e9 req-2eb5fb07-f1cc-4471-84ae-b5b52cae1d98 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=e1b4ed4d-2888-42c9-bb24-200f03c9efe0 HTTP/1.1" status: 200 len: 210 time: 0.0257990 Nov 08 04:17:55.747451 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22198d22-757b-4a03-b778-07cc11fe0c9f req-5fb6b381-de13-4d8f-8a20-82f82ecb5702 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:55.749069 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-22198d22-757b-4a03-b778-07cc11fe0c9f req-5fb6b381-de13-4d8f-8a20-82f82ecb5702 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0550025 Nov 08 04:17:55.798350 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-22198d22-757b-4a03-b778-07cc11fe0c9f req-f534d0b3-fe0e-422e-a210-633bcd77e3a3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433085 Nov 08 04:17:55.923367 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 8bfbc5de-2401-404d-81e1-3e4465bb44c8 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:17:55.943237 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: 8bfbc5de-2401-404d-81e1-3e4465bb44c8 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:17:55.943589 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 8bfbc5de-2401-404d-81e1-3e4465bb44c8 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:17:55.944008 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d29d5bf6-7687-47ca-9dbc-9c6db81cd605 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:17:56.186694 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-ee5a3f54-fcf7-42a5-82d6-d0dad32b5436 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1718587729&fields=id&tenant_id=aa58a6fe20a449858977c517ca68518b HTTP/1.1" status: 200 len: 267 time: 0.0468943 Nov 08 04:17:56.247387 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:17:56.249583 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25492a19-b597-4d50-85c7-d09889b5d381" -d '{"events": [{"server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "name": "network-vif-unplugged", "status": "completed", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:17:56.291199 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db09146-bc11-48f7-a649-e94429094e0d req-73ead1d7-9e3b-43dd-aa83-d22cb410edd7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:56.292873 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-73ead1d7-9e3b-43dd-aa83-d22cb410edd7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 812 time: 0.0993826 Nov 08 04:17:56.308383 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-60bac0cf-9f52-4e63-91d2-4a04858f422e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/quotas/aa58a6fe20a449858977c517ca68518b HTTP/1.1" status: 200 len: 375 time: 0.0092461 Nov 08 04:17:56.319737 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Mon, 08 Nov 2021 04:17:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b389c130-6759-4721-9884-03ecec854b65 x-openstack-request-id: req-b389c130-6759-4721-9884-03ecec854b65 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:17:56.320083 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "name": "network-vif-unplugged", "status": "failed", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605", "code": 422}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:17:56.320338 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-b389c130-6759-4721-9884-03ecec854b65 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:17:56.320752 dv-cinder-783643-4-iscsi neutron-server[101666]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'code': 422} returned with failed status Nov 08 04:17:56.368945 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-6d094a6f-072a-45a2-99f1-27c24a437373 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0536330 Nov 08 04:17:56.472915 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-def782eb-6e60-46d4-8ad1-c9acc082e1ce service neutron] 10.222.0.21 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0915442 Nov 08 04:17:56.562881 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-f0525f9f-08c6-4f63-b86d-16a36c63759f service neutron] 10.222.0.21 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829749 Nov 08 04:17:56.672608 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75e1c164-72fb-4db5-b718-e90b65f15d0c req-aeecf445-ad56-4c73-afd4-36b418875ca9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:56.674138 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-75e1c164-72fb-4db5-b718-e90b65f15d0c req-aeecf445-ad56-4c73-afd4-36b418875ca9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0576017 Nov 08 04:17:56.735636 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-75e1c164-72fb-4db5-b718-e90b65f15d0c req-77d32d7f-b123-4544-ba04-7964c6b7a94b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492299 Nov 08 04:17:56.884289 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-57b32a91-50ec-4bc1-a0ce-31604ac817bc service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0403512 Nov 08 04:17:56.920031 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad59d989-4f2e-4a9f-b4a5-751cd5cac24c req-aadd51f7-e172-42eb-bd6e-f6a983edaa7b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:56.920031 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ad59d989-4f2e-4a9f-b4a5-751cd5cac24c req-aadd51f7-e172-42eb-bd6e-f6a983edaa7b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0545905 Nov 08 04:17:56.973182 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ad59d989-4f2e-4a9f-b4a5-751cd5cac24c req-6e2315c1-82f6-42f0-aaf0-78e52328e5f5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483701 Nov 08 04:17:57.178802 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dc009fd7-3fd1-4dd3-8014-dd3e1d7ed059 req-d13725d4-7864-4935-9f5d-2490a2c637b5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0441439 Nov 08 04:17:57.198821 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dfd931b-ec8b-4607-99f8-3f20b07647e5 req-6bd3316f-2364-482d-8b65-1daf7ed2003c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:57.200239 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dfd931b-ec8b-4607-99f8-3f20b07647e5 req-6bd3316f-2364-482d-8b65-1daf7ed2003c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0768793 Nov 08 04:17:57.264728 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dfd931b-ec8b-4607-99f8-3f20b07647e5 req-18897e05-8167-41c2-ad01-de382c07d4bb tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576525 Nov 08 04:17:57.286529 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57638) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:57.423283 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cebcb1e-7253-44ef-b1e5-9cea5c5cbc19 tempest-TestShelveInstance-2055828473 tempest-TestShelveInstance-2055828473-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:57.424786 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-9cebcb1e-7253-44ef-b1e5-9cea5c5cbc19 tempest-TestShelveInstance-2055828473 tempest-TestShelveInstance-2055828473-project-admin] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 1093 time: 0.1370378 Nov 08 04:17:57.427827 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57642) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:17:57.432092 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Request body: {'floatingip': {'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'port_id': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'fixed_ip_address': '172.20.0.9'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:57.558275 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for floatingip, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:57.658188 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:57.768705 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Allocated IP 172.27.2.222 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/0becc41d-4073-4881-a746-9c27b7d19ca7) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:17:57.867644 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9676e11c-eaa6-4d1c-910b-5e6e0e0858eb req-114f16ed-cf82-4129-98c9-89d875c435b9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:57.869261 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9676e11c-eaa6-4d1c-910b-5e6e0e0858eb req-114f16ed-cf82-4129-98c9-89d875c435b9 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0557942 Nov 08 04:17:57.891514 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:57.925719 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9676e11c-eaa6-4d1c-910b-5e6e0e0858eb req-c7153d4e-a890-4177-b383-bbdc5b867c7c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491743 Nov 08 04:17:57.992929 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:58.029608 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:17:58.033830 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:17:58.039378 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:17:58.065557 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event updated for resources: {'Port': ['ID=0becc41d-4073-4881-a746-9c27b7d19ca7,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:58.275352 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8c3b0c81-4a37-4e47-8e12-0eee7c1ac0fb req-b114461e-5b69-4447-858b-abcd1115393c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256860 Nov 08 04:17:58.690582 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-c3ba62ee-09c5-46ed-91e8-4b73aeffa55a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:58.693130 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-c3ba62ee-09c5-46ed-91e8-4b73aeffa55a service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c&tenant_id=0efb8c7b359746668b199d14191e3f09 HTTP/1.1" status: 200 len: 1097 time: 0.1093621 Nov 08 04:17:58.704456 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:58.778835 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-5e426181-a537-45af-a4da-c93641330e0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:58.780269 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-5e426181-a537-45af-a4da-c93641330e0d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 1097 time: 0.0432060 Nov 08 04:17:58.875952 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:58.925434 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-d7243b56-cd5f-4b2d-963f-980627101884 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:58.927187 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-d7243b56-cd5f-4b2d-963f-980627101884 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 918 time: 0.1392498 Nov 08 04:17:59.059312 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-516220da-6f10-4261-8653-16b8c63a498f service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605 HTTP/1.1" status: 200 len: 999 time: 0.1192741 Nov 08 04:17:59.068452 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffd06d1a-5323-4849-97e6-24bda124f52f req-ce4e9ef7-aa9e-4d4a-9f0a-2ac07649043a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:59.071748 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffd06d1a-5323-4849-97e6-24bda124f52f req-ce4e9ef7-aa9e-4d4a-9f0a-2ac07649043a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0538688 Nov 08 04:17:59.122576 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ffd06d1a-5323-4849-97e6-24bda124f52f req-60d711fd-cbbf-4f62-941e-da7bd57a9629 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436583 Nov 08 04:17:59.143239 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-77679c13-ace0-46a5-91ad-a59c0c8e39b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:59.144693 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-77679c13-ace0-46a5-91ad-a59c0c8e39b7 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.0774779 Nov 08 04:17:59.166369 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:59.194538 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-8f71ab31-4091-4290-a4b9-2614653e1cb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:59.196047 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-8f71ab31-4091-4290-a4b9-2614653e1cb9 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0422056 Nov 08 04:17:59.230121 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:59.344200 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event updated for resources: {'Port': ['ID=0becc41d-4073-4881-a746-9c27b7d19ca7,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:17:59.357661 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:17:59.380399 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-29d6eac2-86c6-485c-b09a-19e90078c8a2 req-fe1a6bc7-d78b-4056-8b9e-20e482a4e7b0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0273328 Nov 08 04:17:59.400947 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-0dbe678b-634c-4b5d-adca-4987e42ac879 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1956179 Nov 08 04:17:59.529835 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.l3_db [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Floating IP 28546093-3395-407b-bf75-6473fba38808 associated. External IP: 172.27.2.222, port: 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a. Nov 08 04:17:59.581473 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-e8e2aa5c-a69e-45a3-aef1-15afa540d8db req-5d7615ca-625d-405f-8b8f-42ad202f2439 service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1722243 Nov 08 04:17:59.609080 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db09146-bc11-48f7-a649-e94429094e0d req-b28d4c79-e176-4b11-93ed-7baf5bbb5f63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:17:59.611035 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-b28d4c79-e176-4b11-93ed-7baf5bbb5f63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 812 time: 0.1117196 Nov 08 04:17:59.685929 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-64d986c4-49eb-4626-8e0d-a90e08d90131 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aa58a6fe20a449858977c517ca68518b HTTP/1.1" status: 200 len: 380 time: 0.0589824 Nov 08 04:17:59.696466 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'port': {'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'admin_state_up': True, 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'security_groups': ['b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb']}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:17:59.768787 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Router 8d32ec67-9649-4b0a-b473-c593c138b81b has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:17:59.892833 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:17:59.905534 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] Sync routers for ids ['8d32ec67-9649-4b0a-b473-c593c138b81b'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:17:59.918431 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Made reservation on behalf of aa58a6fe20a449858977c517ca68518b for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:17:59.919807 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] Routers {'8d32ec67-9649-4b0a-b473-c593c138b81b'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:17:59.920427 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:17:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8d32ec67-9649-4b0a-b473-c593c138b81b'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:17:59.922234 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:00.001114 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:00.052648 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] Set router 8d32ec67-9649-4b0a-b473-c593c138b81b gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:00.060758 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-c7dc5ae0-f32d-49ae-81cd-4cf4daa04727 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.6314490 Nov 08 04:18:00.061392 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:18:00.068429 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-391e3df7-a3ef-4e02-90e7-2a5938fd7736" -d '{"events": [{"name": "network-changed", "server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:18:00.109178 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:18:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e8b04eec-7848-4404-b24f-731eb8eef9a7 x-openstack-request-id: req-e8b04eec-7848-4404-b24f-731eb8eef9a7 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:18:00.109461 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:18:00.112892 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-e8b04eec-7848-4404-b24f-731eb8eef9a7 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:18:00.112892 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'status': 'completed', 'code': 200} Nov 08 04:18:00.124070 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Allocated IP 172.20.0.13 (16cbde97-55ea-47f6-bd55-cf46e7c41a49/5926063e-8f31-4623-9cfc-4a0b577bdb41/5ed549ab-2a42-442b-87e0-565478b5a012) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:18:00.210970 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-e0406751-2d71-4adc-812c-235381aff266 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:00.219553 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-e0406751-2d71-4adc-812c-235381aff266 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=9e6436a3d5084995840a192763eea4ae&device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 1098 time: 0.0576913 Nov 08 04:18:00.377187 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:00.406882 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-44138af1-10a3-4135-ba0a-54cecaba1adb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:00.408360 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-44138af1-10a3-4135-ba0a-54cecaba1adb service neutron] 10.222.0.16 "GET /v2.0/networks?id=6fbc518a-d762-4340-b3c4-10e04086e375 HTTP/1.1" status: 200 len: 910 time: 0.1853273 Nov 08 04:18:00.442243 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '28546093-3395-407b-bf75-6473fba38808', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'floating_ip_address': '172.27.2.222', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'port_id': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'mac_address': 'fa:16:3e:be:a3:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29ef3278-30cd-487b-b434-61021d6472ec', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:17:58Z', 'updated_at': '2021-11-08T04:17:58Z', 'revision_number': 0, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0aae4312-8f40-413f-b687-6b651ec25acd', 'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'mac_address': 'fa:16:3e:e1:0b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:06Z', 'updated_at': '2021-11-08T04:17:11Z', 'revision_number': 5, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'subnets': [{'id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:00.486289 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] Checking router: 8d32ec67-9649-4b0a-b473-c593c138b81b for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:18:00.499580 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] Routers {'8d32ec67-9649-4b0a-b473-c593c138b81b'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:00.501044 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:17:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8d32ec67-9649-4b0a-b473-c593c138b81b'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:00.511828 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6016e4c4-e404-4e4f-865b-f20996f34764 req-f972d788-0367-433b-84d4-209f12ee52d0 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:00.526673 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6016e4c4-e404-4e4f-865b-f20996f34764 req-f972d788-0367-433b-84d4-209f12ee52d0 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.2970421 Nov 08 04:18:00.531266 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:00.617989 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'Port': ['ID=5ed549ab-2a42-442b-87e0-565478b5a012,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:00.665058 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.665428 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.665764 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.666171 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.666564 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.666902 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.667278 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.667607 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.667858 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] Set router 8d32ec67-9649-4b0a-b473-c593c138b81b gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:00.667972 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.668241 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.669220 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.669549 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:00.691848 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:18:00.700956 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:18:00.703466 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:18:00.840831 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eac5e2e7-86b4-446b-b4fa-5977a5a26c94 req-8880fbe0-82fd-4b3d-8924-c08748029e8f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:00.844011 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eac5e2e7-86b4-446b-b4fa-5977a5a26c94 req-8880fbe0-82fd-4b3d-8924-c08748029e8f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 932 time: 0.3140433 Nov 08 04:18:00.849437 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:00.850269 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:00.857031 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6016e4c4-e404-4e4f-865b-f20996f34764 req-90ac3913-0dfd-4df9-bb23-0b88dba710a3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3097486 Nov 08 04:18:00.979225 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eac5e2e7-86b4-446b-b4fa-5977a5a26c94 req-5085f719-635d-4591-87bc-5b50389db201 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1206396 Nov 08 04:18:00.986941 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-43554f31-e0fe-4fac-90b4-5cef7f526bcf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2937768 Nov 08 04:18:01.076781 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '28546093-3395-407b-bf75-6473fba38808', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'floating_ip_address': '172.27.2.222', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'port_id': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'mac_address': 'fa:16:3e:be:a3:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29ef3278-30cd-487b-b434-61021d6472ec', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:17:58Z', 'updated_at': '2021-11-08T04:17:58Z', 'revision_number': 0, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0aae4312-8f40-413f-b687-6b651ec25acd', 'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'mac_address': 'fa:16:3e:e1:0b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:06Z', 'updated_at': '2021-11-08T04:17:11Z', 'revision_number': 5, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'subnets': [{'id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:01.080099 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-10f7f360-3ee0-4672-a5f2-d609fad39917 None None] Provisioning complete for port 5ed549ab-2a42-442b-87e0-565478b5a012 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:18:01.080668 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-10f7f360-3ee0-4672-a5f2-d609fad39917 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:01.110939 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-214cd218-0ad5-48c7-a7e0-9e0bd9e2d006 None None] The sync data for ids ['8d32ec67-9649-4b0a-b473-c593c138b81b'] in dv-cinder-783643-4-iscsi is: [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '28546093-3395-407b-bf75-6473fba38808', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'floating_ip_address': '172.27.2.222', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'port_id': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'mac_address': 'fa:16:3e:be:a3:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29ef3278-30cd-487b-b434-61021d6472ec', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:17:58Z', 'updated_at': '2021-11-08T04:17:58Z', 'revision_number': 0, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0aae4312-8f40-413f-b687-6b651ec25acd', 'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'mac_address': 'fa:16:3e:e1:0b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:06Z', 'updated_at': '2021-11-08T04:17:11Z', 'revision_number': 5, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'subnets': [{'id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:18:01.146001 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-10f7f360-3ee0-4672-a5f2-d609fad39917 None None] Port 5ed549ab-2a42-442b-87e0-565478b5a012 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:18:01.345408 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a79e02b6-4675-4c59-80fd-6ce39fc2576e None None] New status for floating IP 28546093-3395-407b-bf75-6473fba38808: ACTIVE {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:18:01.999484 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32cd4abb-3036-49d0-a5a6-d727bd482650 req-fecdede9-166d-4171-88b2-8fca220ce16c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:02.000981 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32cd4abb-3036-49d0-a5a6-d727bd482650 req-fecdede9-166d-4171-88b2-8fca220ce16c tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0575740 Nov 08 04:18:02.050724 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32cd4abb-3036-49d0-a5a6-d727bd482650 req-c7e5abb6-d06c-417f-a68d-d4cc68403321 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433712 Nov 08 04:18:02.105376 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19520eeb-1756-4c65-bea8-53d67434926c req-0fadfd14-3bdb-47ee-aa39-c0181288d4c4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:02.106900 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-19520eeb-1756-4c65-bea8-53d67434926c req-0fadfd14-3bdb-47ee-aa39-c0181288d4c4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 932 time: 0.0512373 Nov 08 04:18:02.157048 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-19520eeb-1756-4c65-bea8-53d67434926c req-456e5b08-33ce-4c52-aa40-6cd85ab17225 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436954 Nov 08 04:18:03.188077 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331a6c89-2608-412d-8aa2-2f49571f3188 req-c1578b5c-5512-4acf-ba7b-3f9a1f755010 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:03.189567 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-331a6c89-2608-412d-8aa2-2f49571f3188 req-c1578b5c-5512-4acf-ba7b-3f9a1f755010 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0528314 Nov 08 04:18:03.268039 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-331a6c89-2608-412d-8aa2-2f49571f3188 req-5f888aad-d2e4-4d4b-a68a-d30bb2039904 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0697558 Nov 08 04:18:03.303021 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1939e1d-739d-4b2a-81f5-a39565fa29fb req-d09114f9-d0dc-4de2-bf08-d1c6f4d07519 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:03.304485 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f1939e1d-739d-4b2a-81f5-a39565fa29fb req-d09114f9-d0dc-4de2-bf08-d1c6f4d07519 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 932 time: 0.0746233 Nov 08 04:18:03.357121 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f1939e1d-739d-4b2a-81f5-a39565fa29fb req-04e992b8-a37b-47e0-a211-5283cd81b254 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460131 Nov 08 04:18:04.410115 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28669148-6d62-4f65-8431-361fa83d55c2 req-1c436287-d4fb-43e6-9d5c-21415dcc42ac tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:04.411640 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-28669148-6d62-4f65-8431-361fa83d55c2 req-1c436287-d4fb-43e6-9d5c-21415dcc42ac tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0609591 Nov 08 04:18:04.487250 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-28669148-6d62-4f65-8431-361fa83d55c2 req-f1d9c135-8531-4513-9f60-ec0e53bc9e33 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0695553 Nov 08 04:18:04.515966 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d274bc5-f2f9-4a6e-89b6-e47bd8ccd3eb req-5d89c84f-c370-42d3-bddf-68ddb65ebf7f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:04.515966 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8d274bc5-f2f9-4a6e-89b6-e47bd8ccd3eb req-5d89c84f-c370-42d3-bddf-68ddb65ebf7f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 932 time: 0.0773125 Nov 08 04:18:04.559219 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8d274bc5-f2f9-4a6e-89b6-e47bd8ccd3eb req-08eea03c-8009-480c-9d58-230b1bc1a56c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453529 Nov 08 04:18:05.630542 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251e1af0-6930-4bd2-a199-a3ca45b65f0e req-ba3e6633-55f0-46b4-87c3-84909da21b48 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:05.651437 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-251e1af0-6930-4bd2-a199-a3ca45b65f0e req-ba3e6633-55f0-46b4-87c3-84909da21b48 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0693178 Nov 08 04:18:05.726304 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-251e1af0-6930-4bd2-a199-a3ca45b65f0e req-41c8a9e2-50dc-450b-9c95-c8c74df986d8 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0875769 Nov 08 04:18:05.747711 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b852725-0727-407b-895d-230eb2ce9219 req-f1ec4aff-4be8-4cd3-aa79-7d07ceed82a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:05.749477 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4b852725-0727-407b-895d-230eb2ce9219 req-f1ec4aff-4be8-4cd3-aa79-7d07ceed82a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 932 time: 0.0908198 Nov 08 04:18:05.811739 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4b852725-0727-407b-895d-230eb2ce9219 req-e858eaff-e321-4d85-9341-ce7af64c41e4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554073 Nov 08 04:18:06.861600 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f064f1c-b896-44b3-ac3b-9a73222b1a13 req-d58aa952-dc7d-4b9c-b8fe-cc9901e05fca tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:06.863164 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f064f1c-b896-44b3-ac3b-9a73222b1a13 req-d58aa952-dc7d-4b9c-b8fe-cc9901e05fca tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0542541 Nov 08 04:18:06.942855 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f064f1c-b896-44b3-ac3b-9a73222b1a13 req-ceb57def-d49f-4a4c-b4eb-af68bfa7967e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0733633 Nov 08 04:18:06.959867 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2e73bae-6ced-4973-abc6-0e13028ae8b1 req-27c3e62f-137d-461a-9e93-88500d3db782 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:06.962964 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f2e73bae-6ced-4973-abc6-0e13028ae8b1 req-27c3e62f-137d-461a-9e93-88500d3db782 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 932 time: 0.0710394 Nov 08 04:18:07.017444 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f2e73bae-6ced-4973-abc6-0e13028ae8b1 req-7619d2b8-7a13-42a8-aa74-48b1d5ab368b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483046 Nov 08 04:18:08.068569 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67257331-8c43-48df-bbdb-42c7f76a2502 req-b9e83247-44d6-4c69-9df8-a18373911e5b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:08.070118 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-67257331-8c43-48df-bbdb-42c7f76a2502 req-b9e83247-44d6-4c69-9df8-a18373911e5b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0503454 Nov 08 04:18:08.156604 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-67257331-8c43-48df-bbdb-42c7f76a2502 req-73a012b2-52e5-47db-b689-f701a4d7dca3 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0755813 Nov 08 04:18:08.170025 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19f2a7d9-d915-457c-82a3-fd7bffd7e00c req-c347987d-b236-456a-b466-be4f08bf14a6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:08.171482 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-19f2a7d9-d915-457c-82a3-fd7bffd7e00c req-c347987d-b236-456a-b466-be4f08bf14a6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 932 time: 0.0776663 Nov 08 04:18:08.228271 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-19f2a7d9-d915-457c-82a3-fd7bffd7e00c req-07e66d5b-5e40-4922-8c7d-3ac7be5fb7ff tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493929 Nov 08 04:18:08.388830 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-a2f0ef10-bbdc-4523-bcb8-df014f75b25f tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-920049864&fields=id&tenant_id=d23a714c188845279fa19f9c87df4def HTTP/1.1" status: 200 len: 267 time: 0.0632923 Nov 08 04:18:08.438895 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-d8bcadac-0331-4ead-9b24-68ac4a9ebcf8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:08.440407 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-d8bcadac-0331-4ead-9b24-68ac4a9ebcf8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 985 time: 0.0488825 Nov 08 04:18:08.452928 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-a878fc23-9093-4112-bc5e-52e3a205595e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Request body: {'port': {'security_groups': ['125bb1c5-4045-423e-afc6-df481c0f781b']}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:18:08.527186 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-a878fc23-9093-4112-bc5e-52e3a205595e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:08.954267 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-a878fc23-9093-4112-bc5e-52e3a205595e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] For port 0afc78c5-30fe-44b8-be25-b6544e0efa0e, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:08.970303 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:18:08.986298 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-a878fc23-9093-4112-bc5e-52e3a205595e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.055080 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-a878fc23-9093-4112-bc5e-52e3a205595e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.096765 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['0afc78c5-30fe-44b8-be25-b6544e0efa0e'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:18:09.097273 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-a878fc23-9093-4112-bc5e-52e3a205595e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:09.097756 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-a878fc23-9093-4112-bc5e-52e3a205595e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.098945 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31685fbf-09d6-4c13-80b7-dd98c4611bb5 req-a878fc23-9093-4112-bc5e-52e3a205595e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "PUT /v2.0/ports/0afc78c5-30fe-44b8-be25-b6544e0efa0e HTTP/1.1" status: 200 len: 943 time: 0.6516192 Nov 08 04:18:09.099398 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:18:09.102432 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48016892-b59b-4ac0-80bc-bda5430f79d1" -d '{"events": [{"name": "network-changed", "server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:18:09.106758 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57754) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:09.154919 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:18:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c57cca7-68ab-4b23-8516-fc1dd38c99e4 x-openstack-request-id: req-5c57cca7-68ab-4b23-8516-fc1dd38c99e4 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:18:09.155213 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:18:09.155462 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-5c57cca7-68ab-4b23-8516-fc1dd38c99e4 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:18:09.155844 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'status': 'completed', 'code': 200} Nov 08 04:18:09.156868 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a878fc23-9093-4112-bc5e-52e3a205595e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event updated for resources: {'Port': ['ID=0afc78c5-30fe-44b8-be25-b6544e0efa0e,revision_number=7']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:09.221559 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7d6eecc-4e10-4efc-993d-d5d76de0a599 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.263208 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7d6eecc-4e10-4efc-993d-d5d76de0a599 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.318785 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['0afc78c5-30fe-44b8-be25-b6544e0efa0e'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:18:09.390919 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6024b6df-1f77-41b9-9438-c66be8ad287c req-71ba03e6-3be9-4a0b-8c1e-cf666f60029a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:09.395629 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6024b6df-1f77-41b9-9438-c66be8ad287c req-71ba03e6-3be9-4a0b-8c1e-cf666f60029a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.1260531 Nov 08 04:18:09.403970 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2160e450-d187-4f29-9df2-e89b2ff24adf req-3934ba2e-8353-40a6-93cd-dce79bd12f51 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:09.405480 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2160e450-d187-4f29-9df2-e89b2ff24adf req-3934ba2e-8353-40a6-93cd-dce79bd12f51 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 932 time: 0.0817733 Nov 08 04:18:09.449969 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7d6eecc-4e10-4efc-993d-d5d76de0a599 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.453528 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a7d6eecc-4e10-4efc-993d-d5d76de0a599 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.454203 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a7d6eecc-4e10-4efc-993d-d5d76de0a599 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "DELETE /v2.0/security-groups/5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0 HTTP/1.1" status: 204 len: 168 time: 0.3454230 Nov 08 04:18:09.459029 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57762) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:09.473855 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7d6eecc-4e10-4efc-993d-d5d76de0a599 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5605d6d1-66ca-41ec-9caa-8dd3e8ea5be0,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:09.529020 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2160e450-d187-4f29-9df2-e89b2ff24adf req-d9590584-b818-4f51-883c-7c20e1da174b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1046195 Nov 08 04:18:09.537681 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6024b6df-1f77-41b9-9438-c66be8ad287c req-ff8a0065-669f-474d-b200-7fdadf7a1bb7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1310697 Nov 08 04:18:09.551932 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-1e2e6aed-c0f7-40aa-b8a0-41e21398267b None None] Provisioning complete for port 0afc78c5-30fe-44b8-be25-b6544e0efa0e triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:18:09.552170 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1e2e6aed-c0f7-40aa-b8a0-41e21398267b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.678982 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Deleting port f8ffd04d-cec6-41eb-9fcf-c89cd8d0ef22 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:09.679418 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.764206 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.764439 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:09.775826 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Calling delete_port for f8ffd04d-cec6-41eb-9fcf-c89cd8d0ef22 owned by network:floatingip {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:09.998080 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:10.021620 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event deleted for resources: {'Port': ['ID=f8ffd04d-cec6-41eb-9fcf-c89cd8d0ef22,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:10.087751 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks [] for floatingip, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:10.088055 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.l3_db [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Floating IP f3567171-f979-4f22-a34b-d1df1a856cd8 disassociated (deleted). External IP: 172.27.2.145, port: 0afc78c5-30fe-44b8-be25-b6544e0efa0e. Nov 08 04:18:10.298235 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Router b957ebf8-7cce-4f10-a834-1069f67f87ec has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:18:10.411885 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:18:10.420009 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:10.426370 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] Sync routers for ids ['b957ebf8-7cce-4f10-a834-1069f67f87ec'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:18:10.445383 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] Routers {'b957ebf8-7cce-4f10-a834-1069f67f87ec'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:10.446213 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:17:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b957ebf8-7cce-4f10-a834-1069f67f87ec'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:10.463093 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e0f396dd-9d85-4a64-bd6f-936c414a87fe tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "DELETE /v2.0/floatingips/f3567171-f979-4f22-a34b-d1df1a856cd8 HTTP/1.1" status: 204 len: 168 time: 1.0008881 Nov 08 04:18:10.463907 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:18:10.467758 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1" -d '{"events": [{"name": "network-changed", "server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:18:10.613959 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] Set router b957ebf8-7cce-4f10-a834-1069f67f87ec gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:10.714580 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:18:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc52c5e1-5878-434f-92ba-17015335bf05 x-openstack-request-id: req-bc52c5e1-5878-434f-92ba-17015335bf05 {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:18:10.720575 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:18:10.720575 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-bc52c5e1-5878-434f-92ba-17015335bf05 {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:18:10.720575 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'status': 'completed', 'code': 200} Nov 08 04:18:10.849024 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c89c29-a9aa-400b-8722-53bf821cc095 req-80dc71c6-2905-44de-9916-a6c4cb7a87d1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:10.860591 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-45c89c29-a9aa-400b-8722-53bf821cc095 req-80dc71c6-2905-44de-9916-a6c4cb7a87d1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 932 time: 0.0680082 Nov 08 04:18:10.912677 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-45c89c29-a9aa-400b-8722-53bf821cc095 req-54dd35ae-3abd-41c1-8310-2d4ac7733a90 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0539596 Nov 08 04:18:10.990924 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f8d2bcad-96e3-44ea-b4e9-0ae6561bb929', 'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'mac_address': 'fa:16:3e:19:26:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:31Z', 'updated_at': '2021-11-08T04:15:35Z', 'revision_number': 5, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'subnets': [{'id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:10.995431 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731c9c9e-372c-4ab9-8c27-51c5dd5c0f7b req-9f62b9f5-d2e4-428b-918c-9169f50db4ec tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:10.997027 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-731c9c9e-372c-4ab9-8c27-51c5dd5c0f7b req-9f62b9f5-d2e4-428b-918c-9169f50db4ec tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.0689254 Nov 08 04:18:11.020495 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] Checking router: b957ebf8-7cce-4f10-a834-1069f67f87ec for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:18:11.043448 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] Routers {'b957ebf8-7cce-4f10-a834-1069f67f87ec'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:11.044046 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:17:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b957ebf8-7cce-4f10-a834-1069f67f87ec'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:11.044444 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-731c9c9e-372c-4ab9-8c27-51c5dd5c0f7b req-aaa4ac82-c256-4d1b-bc62-8d34fcc2cf68 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415018 Nov 08 04:18:11.159460 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] Set router b957ebf8-7cce-4f10-a834-1069f67f87ec gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:11.354044 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f8d2bcad-96e3-44ea-b4e9-0ae6561bb929', 'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'mac_address': 'fa:16:3e:19:26:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:31Z', 'updated_at': '2021-11-08T04:15:35Z', 'revision_number': 5, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'subnets': [{'id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:11.502814 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-745ed295-47b9-4886-91a2-408b41e4e3be None None] The sync data for ids ['b957ebf8-7cce-4f10-a834-1069f67f87ec'] in dv-cinder-783643-4-iscsi is: [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:15:31Z', 'revision_number': 4, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'f8d2bcad-96e3-44ea-b4e9-0ae6561bb929', 'name': '', 'network_id': '92ef9e7b-7c26-4986-b683-d2777b2485f6', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'mac_address': 'fa:16:3e:19:26:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:31Z', 'updated_at': '2021-11-08T04:15:35Z', 'revision_number': 5, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'subnets': [{'id': '80d1402e-d73c-4668-9cb6-646683e6398f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:18:11.666722 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Request body: {'port': {'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:18:11.731908 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-ea7ec066-337a-47af-97dc-bc4dea9277d9 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a HTTP/1.1" status: 200 len: 1001 time: 0.0702348 Nov 08 04:18:11.762212 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:11.774709 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-ba01c899-e930-4f88-b3df-498fa983cbd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:11.776185 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-ba01c899-e930-4f88-b3df-498fa983cbd7 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d23a714c188845279fa19f9c87df4def&device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 1099 time: 0.1061323 Nov 08 04:18:11.781166 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb2ee4f4-83bb-449e-b750-f3b95c791138 None None] New status for floating IP f3567171-f979-4f22-a34b-d1df1a856cd8: DOWN {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:18:11.815167 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-142ee7f1-d5ea-476c-bddb-da4ceccf6142 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:11.817378 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-142ee7f1-d5ea-476c-bddb-da4ceccf6142 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cde96b9f-aad6-4299-909d-9e2c0a335515 HTTP/1.1" status: 200 len: 848 time: 0.0769086 Nov 08 04:18:11.867410 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-9f435d4b-ac4f-4f29-96d2-659e27581ea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:11.869139 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-9f435d4b-ac4f-4f29-96d2-659e27581ea2 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6fbc518a-d762-4340-b3c4-10e04086e375&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0429845 Nov 08 04:18:11.967845 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-55219ca8-9c6d-4316-8c9a-eb456399ea64 service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895071 Nov 08 04:18:11.991117 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-3d7db8db-bb66-4c78-ac21-9ef5523a7ce5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:11.992449 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-3d7db8db-bb66-4c78-ac21-9ef5523a7ce5 service neutron] 10.222.0.16 "GET /v2.0/networks?id=92ef9e7b-7c26-4986-b683-d2777b2485f6 HTTP/1.1" status: 200 len: 916 time: 0.2046471 Nov 08 04:18:12.070231 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-a009f8ce-c6e4-4ea3-af69-7b7fb629c2d1 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e HTTP/1.1" status: 200 len: 217 time: 0.0579264 Nov 08 04:18:12.087299 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-f6793055-10f5-4ce1-b673-9705f1f3925e service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1038556 Nov 08 04:18:12.212109 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-294082e5-c0f9-46eb-97aa-c628c7d95e95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:12.213533 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-294082e5-c0f9-46eb-97aa-c628c7d95e95 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=80d1402e-d73c-4668-9cb6-646683e6398f HTTP/1.1" status: 200 len: 854 time: 0.1157684 Nov 08 04:18:12.220859 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79548e74-f5b8-4941-908f-1fca30218932 req-bc310796-c93a-438e-8751-084fee6a84d2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:12.222178 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-79548e74-f5b8-4941-908f-1fca30218932 req-bc310796-c93a-438e-8751-084fee6a84d2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 932 time: 0.1911457 Nov 08 04:18:12.302767 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62400c1e-312f-44b6-b7e8-a64c7e1d4135 req-3e197943-fbbc-4b8d-b1c9-70cd822b7386 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:12.304217 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62400c1e-312f-44b6-b7e8-a64c7e1d4135 req-3e197943-fbbc-4b8d-b1c9-70cd822b7386 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.1512618 Nov 08 04:18:12.383571 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-79548e74-f5b8-4941-908f-1fca30218932 req-021da0ed-b840-4173-9021-88e886cb26af tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1533720 Nov 08 04:18:12.404545 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-9f3b5110-686b-4321-9cd2-d3046a52e48c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:12.406026 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-9f3b5110-686b-4321-9cd2-d3046a52e48c service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=92ef9e7b-7c26-4986-b683-d2777b2485f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1520100 Nov 08 04:18:12.411173 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5ed549ab-2a42-442b-87e0-565478b5a012 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:18:12.434262 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:12.467537 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62400c1e-312f-44b6-b7e8-a64c7e1d4135 req-24c0ae0b-c92d-44e6-95d6-a95de7481c50 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1508455 Nov 08 04:18:12.501304 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Transition to ACTIVE for port object 5ed549ab-2a42-442b-87e0-565478b5a012 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:18:12.529463 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-0b3c885e-3ca7-4db2-8f18-3cc17bd07efd service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1115372 Nov 08 04:18:12.554735 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:12.632441 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-ab77ead5-55c8-4f41-87aa-0b5d4117e2a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:12.651721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Pushing event updated for resources: {'Port': ['ID=5ed549ab-2a42-442b-87e0-565478b5a012,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:12.713003 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48016892-b59b-4ac0-80bc-bda5430f79d1 req-f000f91b-176a-41bd-bff4-f0a71e9854ad service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1757016 Nov 08 04:18:12.743821 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Attempting to bind port 5ed549ab-2a42-442b-87e0-565478b5a012 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:18:12.744329 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Attempting to bind port 5ed549ab-2a42-442b-87e0-565478b5a012 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:18:12.744642 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Attempting to bind port 5ed549ab-2a42-442b-87e0-565478b5a012 on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:18:12.750771 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Port 5ed549ab-2a42-442b-87e0-565478b5a012 on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:18:12.751099 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Attempting to bind port 5ed549ab-2a42-442b-87e0-565478b5a012 on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:18:12.756182 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 17, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:18:12.756523 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Checking segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:18:12.757592 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Bound using segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:18:12.758041 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Bound port: 5ed549ab-2a42-442b-87e0-565478b5a012, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:18:12.758742 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:12.826263 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] For port 5ed549ab-2a42-442b-87e0-565478b5a012, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:18:12.829120 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] For port 5ed549ab-2a42-442b-87e0-565478b5a012, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=5ed549ab-2a42-442b-87e0-565478b5a012,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:18:12.907298 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:12.942316 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:12.943114 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:12.944456 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] 10.222.0.16 "PUT /v2.0/ports/5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1094 time: 1.2819669 Nov 08 04:18:12.947056 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d56d482-c782-406d-84dd-036e79b29b4a', 'tag': '5ed549ab-2a42-442b-87e0-565478b5a012'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:18:12.949313 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e5977245-cb96-4295-a005-93641191e649" -d '{"events": [{"name": "network-changed", "server_uuid": "7d56d482-c782-406d-84dd-036e79b29b4a", "tag": "5ed549ab-2a42-442b-87e0-565478b5a012"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:18:12.979414 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-71f53097-20ee-40d9-ad17-bd2c1788ea71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:12.981582 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-71f53097-20ee-40d9-ad17-bd2c1788ea71 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=d23a714c188845279fa19f9c87df4def&device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 1099 time: 0.1041205 Nov 08 04:18:12.985354 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e961e9b-52e8-46a4-aaed-07237efa2b9d service neutron] Pushing event updated for resources: {'Port': ['ID=5ed549ab-2a42-442b-87e0-565478b5a012,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:12.998543 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:18:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42cad1a4-5a9c-44ba-8159-e55de947896f x-openstack-request-id: req-42cad1a4-5a9c-44ba-8159-e55de947896f {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:18:12.999156 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d56d482-c782-406d-84dd-036e79b29b4a", "tag": "5ed549ab-2a42-442b-87e0-565478b5a012", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:18:12.999156 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-42cad1a4-5a9c-44ba-8159-e55de947896f {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:18:12.999447 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d56d482-c782-406d-84dd-036e79b29b4a', 'tag': '5ed549ab-2a42-442b-87e0-565478b5a012', 'status': 'completed', 'code': 200} Nov 08 04:18:13.111930 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5977245-cb96-4295-a005-93641191e649 req-03a7369a-ae30-4f17-ac88-0888a813439d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.113440 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5977245-cb96-4295-a005-93641191e649 req-03a7369a-ae30-4f17-ac88-0888a813439d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1097 time: 0.0644474 Nov 08 04:18:13.116340 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-9d9c2a15-0476-422e-ba36-d3e7ad16c7be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.117654 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-9d9c2a15-0476-422e-ba36-d3e7ad16c7be service neutron] 10.222.0.16 "GET /v2.0/networks?id=92ef9e7b-7c26-4986-b683-d2777b2485f6 HTTP/1.1" status: 200 len: 916 time: 0.1286285 Nov 08 04:18:13.192366 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-4fe23706-74e1-44b6-9cf1-30d66bf28229 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e HTTP/1.1" status: 200 len: 217 time: 0.0545669 Nov 08 04:18:13.298588 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-c361a58e-95f6-4f2f-aa61-454751cced5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.300006 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-c361a58e-95f6-4f2f-aa61-454751cced5a service neutron] 10.222.0.16 "GET /v2.0/subnets?id=80d1402e-d73c-4668-9cb6-646683e6398f HTTP/1.1" status: 200 len: 854 time: 0.0760231 Nov 08 04:18:13.302540 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5977245-cb96-4295-a005-93641191e649 req-b187a0d9-4598-4966-a2d5-56012bcdb83a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.303869 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5977245-cb96-4295-a005-93641191e649 req-b187a0d9-4598-4966-a2d5-56012bcdb83a service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=aa58a6fe20a449858977c517ca68518b&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1673062 Nov 08 04:18:13.408701 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-1092042b-fec0-456b-a8b3-68f53d5164bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.410093 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-1092042b-fec0-456b-a8b3-68f53d5164bb service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=92ef9e7b-7c26-4986-b683-d2777b2485f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0964339 Nov 08 04:18:13.464612 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5977245-cb96-4295-a005-93641191e649 req-dbad71ce-d913-4b3a-bc97-151c46607bcd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.466017 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5977245-cb96-4295-a005-93641191e649 req-dbad71ce-d913-4b3a-bc97-151c46607bcd service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1512678 Nov 08 04:18:13.576419 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d1b5f49-a8fe-4ee1-80ad-a5044716d9fa req-170271b9-8deb-46b9-a532-556d811de16e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.577889 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d1b5f49-a8fe-4ee1-80ad-a5044716d9fa req-170271b9-8deb-46b9-a532-556d811de16e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 944 time: 0.1240025 Nov 08 04:18:13.615064 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-1cf2558d-0f7e-436e-9c84-03b24e881bad service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1960392 Nov 08 04:18:13.677676 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db09146-bc11-48f7-a649-e94429094e0d req-49cb3cd8-08e0-4c0d-a220-ad0825db9127 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.679058 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-49cb3cd8-08e0-4c0d-a220-ad0825db9127 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1097 time: 0.1487300 Nov 08 04:18:13.717219 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd74856f-f96c-48fe-a196-24d644eb488d req-54dfa53c-a824-4bf6-9f0b-dbf981e82429 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.718668 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dd74856f-f96c-48fe-a196-24d644eb488d req-54dfa53c-a824-4bf6-9f0b-dbf981e82429 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 944 time: 0.1762199 Nov 08 04:18:13.776921 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d1b5f49-a8fe-4ee1-80ad-a5044716d9fa req-03c5e876-2fe6-4028-8591-d13fca33d9cd tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1894445 Nov 08 04:18:13.785259 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-c1689e5f-89a8-43a1-b223-bc8eef05d41c service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 217 time: 0.0782781 Nov 08 04:18:13.863979 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-86d6335b-8c2c-4507-a409-7c8c39be2bca service neutron] 10.222.0.16 "GET /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2392023 Nov 08 04:18:13.872393 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dd74856f-f96c-48fe-a196-24d644eb488d req-bd60b5db-ad7b-4ebf-9784-1582e689e0c7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1424408 Nov 08 04:18:13.873863 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db09146-bc11-48f7-a649-e94429094e0d req-fb64c046-7649-42a5-b124-879b08d1d22e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.875245 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-fb64c046-7649-42a5-b124-879b08d1d22e service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0818975 Nov 08 04:18:13.925835 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db09146-bc11-48f7-a649-e94429094e0d req-398541f7-be6b-4fc4-97a3-7f0e563cc1aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:13.927329 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-398541f7-be6b-4fc4-97a3-7f0e563cc1aa service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392787 Nov 08 04:18:14.011897 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d29d5bf6-7687-47ca-9dbc-9c6db81cd605 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:18:14.019998 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-d44014fe-26a1-4599-8f19-104561dd25be service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852871 Nov 08 04:18:14.105944 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:14.106653 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6db09146-bc11-48f7-a649-e94429094e0d req-4e51b052-df5a-4729-ac8b-b67874b925ac service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0788178 Nov 08 04:18:14.117797 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'port_id': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'mac_address': 'fa:16:3e:70:81:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 184, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:18:14.156283 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:14.173356 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d29d5bf6-7687-47ca-9dbc-9c6db81cd605 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:18:14.191465 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:14.243202 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:14.290459 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=9']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:14.297774 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.298116 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.298449 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.298802 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.299126 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.299450 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.299771 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.300089 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.300407 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.300724 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.301040 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.301349 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:14.582574 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['d29d5bf6-7687-47ca-9dbc-9c6db81cd605'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:18:14.888741 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64be6479-fc57-4618-b332-8e0abd8c37ff req-44ff6eb1-327a-4847-ae9e-9d806e7108fa tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:14.890094 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-64be6479-fc57-4618-b332-8e0abd8c37ff req-44ff6eb1-327a-4847-ae9e-9d806e7108fa tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 944 time: 0.0470989 Nov 08 04:18:14.941469 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-64be6479-fc57-4618-b332-8e0abd8c37ff req-5cf3094d-8c8a-4f70-a284-1b99f4e7bc32 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454957 Nov 08 04:18:14.988901 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-371e309a-45ca-4205-8835-3cfdd26cea57 req-e4dcab1b-a3b6-45f6-9ca6-c950fc39b832 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:14.990344 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-371e309a-45ca-4205-8835-3cfdd26cea57 req-e4dcab1b-a3b6-45f6-9ca6-c950fc39b832 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 945 time: 0.0477209 Nov 08 04:18:15.036278 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-371e309a-45ca-4205-8835-3cfdd26cea57 req-0f83b90d-9217-4671-b69a-c6004f2464f1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399904 Nov 08 04:18:15.139940 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-0e73727d-c453-4cae-a9c5-0bf6f71cb360 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:16.060237 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:16.060237 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d29d5bf6-7687-47ca-9dbc-9c6db81cd605 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:18:16.061599 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd22cac3-c04d-450c-9dab-435d4e1ba649 req-dc9b6fd9-0aeb-4b40-9843-417b67ca4ef9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:16.063118 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd22cac3-c04d-450c-9dab-435d4e1ba649 req-dc9b6fd9-0aeb-4b40-9843-417b67ca4ef9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 944 time: 0.0517640 Nov 08 04:18:16.078143 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:18:16.078566 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:16.124430 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd22cac3-c04d-450c-9dab-435d4e1ba649 req-559f9a03-6ab4-4aec-966c-2aa94fafa6bc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543942 Nov 08 04:18:16.155888 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:16.165517 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2faff57-a037-47db-a6f1-1c10f747bbd6 req-855f06ea-3979-479b-abd6-0a028ad06022 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:16.167654 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f2faff57-a037-47db-a6f1-1c10f747bbd6 req-855f06ea-3979-479b-abd6-0a028ad06022 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 945 time: 0.0560873 Nov 08 04:18:16.178661 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:18:16.180848 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ff7ff03e-85e6-4d53-8a4f-7a4562c986ef" -d '{"events": [{"server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "name": "network-vif-plugged", "status": "completed", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:18:16.198257 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:16.216401 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f2faff57-a037-47db-a6f1-1c10f747bbd6 req-53b71255-afe0-49e1-91a1-1016756189ec tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428002 Nov 08 04:18:16.218584 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:18:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6421cd1b-8361-46e7-8ded-f4d28891e410 x-openstack-request-id: req-6421cd1b-8361-46e7-8ded-f4d28891e410 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:18:16.218818 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "name": "network-vif-plugged", "status": "completed", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:18:16.219067 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-6421cd1b-8361-46e7-8ded-f4d28891e410 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:18:16.219692 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'code': 200} Nov 08 04:18:16.255398 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:16.303784 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=10']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:16.509960 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e4a3dd5-7ec3-40e4-8b25-e09d0f9a3576 req-d48031f6-786f-4ff9-84c8-a039bd6d92cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:16.511375 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9e4a3dd5-7ec3-40e4-8b25-e09d0f9a3576 req-d48031f6-786f-4ff9-84c8-a039bd6d92cf service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 1100 time: 0.0396655 Nov 08 04:18:16.553904 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9e4a3dd5-7ec3-40e4-8b25-e09d0f9a3576 req-5f703aa0-279c-4c99-935e-da7ba017e4c0 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0356069 Nov 08 04:18:17.239079 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ebfaa2-212d-4e72-80d4-1acb4606e9c6 req-0026fb38-693e-4666-ad10-d750e3e721d6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:17.240515 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-05ebfaa2-212d-4e72-80d4-1acb4606e9c6 req-0026fb38-693e-4666-ad10-d750e3e721d6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 944 time: 0.0500145 Nov 08 04:18:17.288526 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-05ebfaa2-212d-4e72-80d4-1acb4606e9c6 req-5b3918b6-332e-4d5f-af10-f3ac4d5711d6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412245 Nov 08 04:18:17.335868 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-896fe0f3-f650-4a3a-9daa-abd65dd7e709 req-1b7a9dcc-70a5-46cf-b3af-8d687686c001 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:17.337339 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-896fe0f3-f650-4a3a-9daa-abd65dd7e709 req-1b7a9dcc-70a5-46cf-b3af-8d687686c001 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 947 time: 0.0479615 Nov 08 04:18:17.384367 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-896fe0f3-f650-4a3a-9daa-abd65dd7e709 req-96782882-fbd2-45ff-b625-a77b48bc4664 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411835 Nov 08 04:18:17.603640 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:18.375303 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:18.404556 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34b1e7c0-f53c-4adc-ad8e-b918436fc8a0 req-4ee4b226-4e8f-4a25-a9fa-8e6966f20cdf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:18.406026 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34b1e7c0-f53c-4adc-ad8e-b918436fc8a0 req-4ee4b226-4e8f-4a25-a9fa-8e6966f20cdf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 944 time: 0.0495009 Nov 08 04:18:18.464599 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34b1e7c0-f53c-4adc-ad8e-b918436fc8a0 req-08456386-b18c-467d-a45b-9eaf70389402 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523815 Nov 08 04:18:18.523941 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa60cd8-4dba-4391-a17f-0d81a8987328 req-cf329718-2459-4cc9-a61f-38376aa9ed04 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:18.525374 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2aa60cd8-4dba-4391-a17f-0d81a8987328 req-cf329718-2459-4cc9-a61f-38376aa9ed04 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 947 time: 0.0523469 Nov 08 04:18:18.574358 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2aa60cd8-4dba-4391-a17f-0d81a8987328 req-9bc1a7f5-f42a-4cff-a25f-96424a200fb7 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429332 Nov 08 04:18:19.585738 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac3b9ba5-41ad-421a-a54f-54b4266cee06 req-d20df4b1-e9fd-477c-b783-98cbc5734810 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:19.587227 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac3b9ba5-41ad-421a-a54f-54b4266cee06 req-d20df4b1-e9fd-477c-b783-98cbc5734810 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 944 time: 0.0472562 Nov 08 04:18:19.637641 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac3b9ba5-41ad-421a-a54f-54b4266cee06 req-fbd320cb-6e6f-4ab2-8920-5290edcda781 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437717 Nov 08 04:18:19.694934 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d83372e-8fb0-4a9e-bf92-c91afee6f7b4 req-566769bc-5188-4d2f-a4d3-2febca718bf1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:19.696293 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d83372e-8fb0-4a9e-bf92-c91afee6f7b4 req-566769bc-5188-4d2f-a4d3-2febca718bf1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 947 time: 0.0507123 Nov 08 04:18:19.741757 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d83372e-8fb0-4a9e-bf92-c91afee6f7b4 req-4ec4b54b-3820-4c65-8897-4fc442fb62b2 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388415 Nov 08 04:18:20.749751 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06dcb7b0-81a7-4067-8896-93f33f0673e3 req-761e627c-71a8-46f7-af78-5d9858636bb7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:20.751275 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06dcb7b0-81a7-4067-8896-93f33f0673e3 req-761e627c-71a8-46f7-af78-5d9858636bb7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 944 time: 0.0476267 Nov 08 04:18:20.799261 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06dcb7b0-81a7-4067-8896-93f33f0673e3 req-531edab3-d899-46d7-a4da-f56599603b3e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420270 Nov 08 04:18:21.917623 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdabfa56-d500-4ecc-8fd8-184521f1bc85 req-698f93fe-8ab5-4d3c-933e-de88af16b34a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:21.919294 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bdabfa56-d500-4ecc-8fd8-184521f1bc85 req-698f93fe-8ab5-4d3c-933e-de88af16b34a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 944 time: 0.0517411 Nov 08 04:18:21.971936 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bdabfa56-d500-4ecc-8fd8-184521f1bc85 req-602ceaf1-4537-4d5b-ac88-383db7d09aa0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464075 Nov 08 04:18:22.059451 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 5ed549ab-2a42-442b-87e0-565478b5a012 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:18:22.154622 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 5ed549ab-2a42-442b-87e0-565478b5a012, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=5ed549ab-2a42-442b-87e0-565478b5a012,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:22.167678 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '5ed549ab-2a42-442b-87e0-565478b5a012', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'mac_address': 'fa:16:3e:24:43:f8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 186, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:18:22.203470 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:22.216171 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5ed549ab-2a42-442b-87e0-565478b5a012 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:18:22.235294 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 5ed549ab-2a42-442b-87e0-565478b5a012, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=5ed549ab-2a42-442b-87e0-565478b5a012,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:22.323984 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:22.377676 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=5ed549ab-2a42-442b-87e0-565478b5a012,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:22.690685 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['5ed549ab-2a42-442b-87e0-565478b5a012'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:18:23.087148 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbd3baa8-3a3a-4856-a1e1-090930263aee req-b04d9b93-fb66-4b76-9fc7-5cfab996a5cf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:23.088605 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbd3baa8-3a3a-4856-a1e1-090930263aee req-b04d9b93-fb66-4b76-9fc7-5cfab996a5cf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 945 time: 0.0479009 Nov 08 04:18:23.138673 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbd3baa8-3a3a-4856-a1e1-090930263aee req-9eff2cfa-401d-484e-b463-c2816cc9a344 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441267 Nov 08 04:18:23.281267 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a58e4b-a173-4f1d-8b76-64301a412da3 req-73b4cceb-56f8-4ca6-97ff-4eb743f07fd7 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:23.282792 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d3a58e4b-a173-4f1d-8b76-64301a412da3 req-73b4cceb-56f8-4ca6-97ff-4eb743f07fd7 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.0477414 Nov 08 04:18:23.328858 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d3a58e4b-a173-4f1d-8b76-64301a412da3 req-d93ba8b6-5228-4da2-849a-70b2af21ce4d tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400639 Nov 08 04:18:24.071826 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 5ed549ab-2a42-442b-87e0-565478b5a012 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:18:24.197995 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 5ed549ab-2a42-442b-87e0-565478b5a012 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:18:24.201971 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 5ed549ab-2a42-442b-87e0-565478b5a012 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:18:24.202450 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:24.259976 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-191db93a-7483-48c8-81a0-85d436d2dff7 req-ad8c53fd-d3f4-4094-ae83-a67ae217317c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:24.261373 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-191db93a-7483-48c8-81a0-85d436d2dff7 req-ad8c53fd-d3f4-4094-ae83-a67ae217317c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 945 time: 0.0529046 Nov 08 04:18:24.266411 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:24.283638 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:24.305744 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d56d482-c782-406d-84dd-036e79b29b4a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ed549ab-2a42-442b-87e0-565478b5a012'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:18:24.308008 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9c4a4e8-3c47-41d1-99cb-4437c4d83aa0" -d '{"events": [{"server_uuid": "7d56d482-c782-406d-84dd-036e79b29b4a", "name": "network-vif-plugged", "status": "completed", "tag": "5ed549ab-2a42-442b-87e0-565478b5a012"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:18:24.310253 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-191db93a-7483-48c8-81a0-85d436d2dff7 req-335ae8a6-6c6b-4939-b75f-2bf1c4963841 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429463 Nov 08 04:18:24.321453 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 5ed549ab-2a42-442b-87e0-565478b5a012, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=5ed549ab-2a42-442b-87e0-565478b5a012,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:24.350021 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:18:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59402ea1-f574-46e7-8e5b-76b8a3a92a79 x-openstack-request-id: req-59402ea1-f574-46e7-8e5b-76b8a3a92a79 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:18:24.350021 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7d56d482-c782-406d-84dd-036e79b29b4a", "name": "network-vif-plugged", "status": "completed", "tag": "5ed549ab-2a42-442b-87e0-565478b5a012", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:18:24.350021 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-59402ea1-f574-46e7-8e5b-76b8a3a92a79 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:18:24.350021 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d56d482-c782-406d-84dd-036e79b29b4a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ed549ab-2a42-442b-87e0-565478b5a012', 'code': 200} Nov 08 04:18:24.397876 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:24.441932 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf42e8b7-6f45-4bb8-9a43-d5e886eabcb2 req-297c7c0e-6cf7-434d-b5b4-58cf44f269f3 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:24.443427 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cf42e8b7-6f45-4bb8-9a43-d5e886eabcb2 req-297c7c0e-6cf7-434d-b5b4-58cf44f269f3 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.0504060 Nov 08 04:18:24.446851 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=5ed549ab-2a42-442b-87e0-565478b5a012,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:24.493128 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cf42e8b7-6f45-4bb8-9a43-d5e886eabcb2 req-92612f42-f7b9-494a-a76f-e7f72dd1d08e tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435333 Nov 08 04:18:24.818668 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ea71dd6-c102-4090-807a-b2e5faa3fc52 req-83bcc386-9011-4af7-b74a-3dcfc9cbf9a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:24.820244 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ea71dd6-c102-4090-807a-b2e5faa3fc52 req-83bcc386-9011-4af7-b74a-3dcfc9cbf9a6 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0408525 Nov 08 04:18:24.866675 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ea71dd6-c102-4090-807a-b2e5faa3fc52 req-0606f464-71dc-4a37-8bef-03bd2b14f907 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374024 Nov 08 04:18:25.424321 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4287d5a9-ecf0-4f5f-9b8f-c6e2a82471a1 req-7299c946-e3b8-4483-953b-62c5538c963c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:25.425700 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4287d5a9-ecf0-4f5f-9b8f-c6e2a82471a1 req-7299c946-e3b8-4483-953b-62c5538c963c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 946 time: 0.0467768 Nov 08 04:18:25.472975 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4287d5a9-ecf0-4f5f-9b8f-c6e2a82471a1 req-12baf7bd-d35c-4874-b5fa-00cd5b6a2be2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414820 Nov 08 04:18:25.604130 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bd611a-4166-4ab3-836f-a152ebcfc4c7 req-46a3bedc-4fa7-4d8a-a20b-7fe0d63a953c tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:25.606089 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-71bd611a-4166-4ab3-836f-a152ebcfc4c7 req-46a3bedc-4fa7-4d8a-a20b-7fe0d63a953c tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.0469584 Nov 08 04:18:25.654909 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-71bd611a-4166-4ab3-836f-a152ebcfc4c7 req-d85a0eed-d313-4da4-b6ec-7b5bd7226027 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/security-groups?id=125bb1c5-4045-423e-afc6-df481c0f781b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426145 Nov 08 04:18:25.880884 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-f84535b7-b0d8-4862-b9be-67eff4e195eb tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:25.882286 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-f84535b7-b0d8-4862-b9be-67eff4e195eb tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.16 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 946 time: 0.0527287 Nov 08 04:18:25.970922 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-52ccfdd1-fa69-4438-8344-94f215b050bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Deleting port 0afc78c5-30fe-44b8-be25-b6544e0efa0e {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:25.971257 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-52ccfdd1-fa69-4438-8344-94f215b050bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:26.058589 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-52ccfdd1-fa69-4438-8344-94f215b050bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] For port 0afc78c5-30fe-44b8-be25-b6544e0efa0e, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0afc78c5-30fe-44b8-be25-b6544e0efa0e,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:26.058943 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-52ccfdd1-fa69-4438-8344-94f215b050bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:26.070964 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-52ccfdd1-fa69-4438-8344-94f215b050bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Calling delete_port for 0afc78c5-30fe-44b8-be25-b6544e0efa0e owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:26.501567 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-52ccfdd1-fa69-4438-8344-94f215b050bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:26.530415 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52ccfdd1-fa69-4438-8344-94f215b050bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Pushing event deleted for resources: {'Port': ['ID=0afc78c5-30fe-44b8-be25-b6544e0efa0e,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:26.542700 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['0afc78c5-30fe-44b8-be25-b6544e0efa0e'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:18:26.594752 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-52ccfdd1-fa69-4438-8344-94f215b050bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] No DVR routers for this DVR port 0afc78c5-30fe-44b8-be25-b6544e0efa0e on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:18:26.606358 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-52ccfdd1-fa69-4438-8344-94f215b050bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:26.611188 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7acd1b99-6c32-4bcb-9443-28577efc4218 req-52ccfdd1-fa69-4438-8344-94f215b050bc tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.16 "DELETE /v2.0/ports/0afc78c5-30fe-44b8-be25-b6544e0efa0e HTTP/1.1" status: 204 len: 173 time: 0.7221515 Nov 08 04:18:26.611841 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'name': 'network-vif-deleted', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:18:26.614310 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebcb922c-7631-44e9-9b86-bbf5c7757db6" -d '{"events": [{"server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "name": "network-vif-deleted", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:18:26.640682 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b14502ab-9a67-4510-8f22-b6097ceca2c7 req-de663ae7-4dbd-4038-8e14-732f126f66cc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:26.642266 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b14502ab-9a67-4510-8f22-b6097ceca2c7 req-de663ae7-4dbd-4038-8e14-732f126f66cc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 946 time: 0.0882010 Nov 08 04:18:26.661617 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:18:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6e4165f-a966-4513-91c1-f75cc82d82c1 x-openstack-request-id: req-e6e4165f-a966-4513-91c1-f75cc82d82c1 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:18:26.663882 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9cf104fc-d344-4175-ab31-20087fd691b4", "name": "network-vif-deleted", "tag": "0afc78c5-30fe-44b8-be25-b6544e0efa0e", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:18:26.663882 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-e6e4165f-a966-4513-91c1-f75cc82d82c1 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:18:26.663882 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9cf104fc-d344-4175-ab31-20087fd691b4', 'name': 'network-vif-deleted', 'tag': '0afc78c5-30fe-44b8-be25-b6544e0efa0e', 'status': 'completed', 'code': 200} Nov 08 04:18:26.720041 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b14502ab-9a67-4510-8f22-b6097ceca2c7 req-5de0430d-f492-46f2-b732-fc799b4191e9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0693741 Nov 08 04:18:26.722782 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-84cdadb5-4758-4e00-a0d4-cd33ffa73a2d service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0796163 Nov 08 04:18:26.761155 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6cf77deb-1c4b-4462-b8ad-f52d79a8f3ee req-4022808a-3e35-495a-854d-defd06748fe8 tempest-TestMinimumBasicScenario-297879215 tempest-TestMinimumBasicScenario-297879215-project] 10.222.0.21 "GET /v2.0/ports?device_id=9cf104fc-d344-4175-ab31-20087fd691b4 HTTP/1.1" status: 200 len: 210 time: 0.0351930 Nov 08 04:18:26.862195 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-70607d3d-91c7-4fdc-8071-84f6ee2ffc96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:26.863619 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-70607d3d-91c7-4fdc-8071-84f6ee2ffc96 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=0efb8c7b359746668b199d14191e3f09&device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 1100 time: 0.0796032 Nov 08 04:18:26.872014 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5a0033-3d2b-4a81-91d5-9666903ce275 req-ab5b8729-f619-4bdf-b5a1-bd12c7fff554 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:26.873400 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3b5a0033-3d2b-4a81-91d5-9666903ce275 req-ab5b8729-f619-4bdf-b5a1-bd12c7fff554 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 946 time: 0.0797729 Nov 08 04:18:26.980746 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3b5a0033-3d2b-4a81-91d5-9666903ce275 req-d10a7eac-b71e-486a-8076-b521c90f19c9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1004241 Nov 08 04:18:27.003465 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-88c39743-dc74-46d8-b0cb-768be3a4b45d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:27.018396 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-88c39743-dc74-46d8-b0cb-768be3a4b45d service neutron] 10.222.0.16 "GET /v2.0/networks?id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 200 len: 918 time: 0.1179950 Nov 08 04:18:27.019560 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 57964) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:27.100125 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-fabbe2cb-acf0-49c0-92b2-d87729ccb34b service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605 HTTP/1.1" status: 200 len: 1001 time: 0.0875535 Nov 08 04:18:27.106269 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-199d150d-433a-403b-ad71-b456057ce70d tempest-TestVolumeBootPattern-2005605993 tempest-TestVolumeBootPattern-2005605993-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:27.108010 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-199d150d-433a-403b-ad71-b456057ce70d tempest-TestVolumeBootPattern-2005605993 tempest-TestVolumeBootPattern-2005605993-project-admin] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1094 time: 0.0872293 Nov 08 04:18:27.111070 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 57966) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:27.116274 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'floatingip': {'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address': '172.20.0.13'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:18:27.158422 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-27974773-29c4-4a1e-b612-a01396ac8518 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:27.159861 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-27974773-29c4-4a1e-b612-a01396ac8518 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 200 len: 856 time: 0.0442770 Nov 08 04:18:27.212976 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-787d6509-de67-4606-bbaf-91b2a59781a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:27.214437 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-787d6509-de67-4606-bbaf-91b2a59781a2 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0461276 Nov 08 04:18:27.226629 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:27.302846 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-0c4f0b24-bff5-4193-99ec-bd9bad063a2b service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797379 Nov 08 04:18:27.320634 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:27.400273 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af45c75b-6d12-4711-9eef-0b08420e7da0 req-68ad8c45-a6f9-4255-a1bd-dabc21cd415d service neutron] 10.222.0.16 "GET /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889437 Nov 08 04:18:27.700601 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_common [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Allocated IP 172.27.2.47 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/7c0b0bd5-cf88-4040-b07f-e65b8412df0e) {{(pid=101664) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:18:27.809102 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for port, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:27.921206 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:27.955884 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101664) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:18:27.958972 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Resources bound (agent type, host, resource id): {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:18:27.961599 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Received port after_create {{(pid=101664) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:18:27.995262 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'Port': ['ID=7c0b0bd5-cf88-4040-b07f-e65b8412df0e,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:28.339759 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:28.439509 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:28.592536 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for port, precommit_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:28.637665 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5120823'] for port, after_update {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:28.707751 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'Port': ['ID=7c0b0bd5-cf88-4040-b07f-e65b8412df0e,revision_number=2']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:28.719781 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:28.814125 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.l3_db [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Floating IP 00ce2f97-4322-45b8-8cd1-e53e8e1e43b6 associated. External IP: 172.27.2.47, port: 5ed549ab-2a42-442b-87e0-565478b5a012. Nov 08 04:18:29.024042 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Router 8aa2c265-b728-4ac3-97de-f276d80d2037 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:18:29.058270 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58012) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:29.135283 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:18:29.145285 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] Sync routers for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:18:29.154504 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:29.158707 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:29.200308 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:29.238504 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-c05d73c8-537d-42f2-bae3-5c9638c85ae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.1161287 Nov 08 04:18:29.238504 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d56d482-c782-406d-84dd-036e79b29b4a', 'tag': '5ed549ab-2a42-442b-87e0-565478b5a012'}] {{(pid=101664) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:18:29.238504 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5c67dad75db1d04c90befff096bcc6c93a37c35ebe6e4afe59b8453d03721c88" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1dcf0c73-851e-4d7c-8702-af369f7bc836" -d '{"events": [{"name": "network-changed", "server_uuid": "7d56d482-c782-406d-84dd-036e79b29b4a", "tag": "5ed549ab-2a42-442b-87e0-565478b5a012"}]}' {{(pid=101664) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:18:29.272568 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:18:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3333b640-1d4e-468a-9c32-fc16189057ac x-openstack-request-id: req-3333b640-1d4e-468a-9c32-fc16189057ac {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:18:29.272969 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d56d482-c782-406d-84dd-036e79b29b4a", "tag": "5ed549ab-2a42-442b-87e0-565478b5a012", "status": "completed", "code": 200}]} {{(pid=101664) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:18:29.273306 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-3333b640-1d4e-468a-9c32-fc16189057ac {{(pid=101664) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:18:29.273927 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d56d482-c782-406d-84dd-036e79b29b4a', 'tag': '5ed549ab-2a42-442b-87e0-565478b5a012', 'status': 'completed', 'code': 200} Nov 08 04:18:29.277098 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:29.411856 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-ce6d34ce-b229-45b6-8c3d-e094d7ca858b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:29.413319 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-ce6d34ce-b229-45b6-8c3d-e094d7ca858b service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0753355 Nov 08 04:18:29.495067 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '00ce2f97-4322-45b8-8cd1-e53e8e1e43b6', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:24:43:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:18:28Z', 'updated_at': '2021-11-08T04:18:28Z', 'revision_number': 0, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:29.520937 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] Checking router: 8aa2c265-b728-4ac3-97de-f276d80d2037 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:18:29.529681 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:29.530211 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:29.575587 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-e3e8c7a6-74b5-4bb6-b293-f8ea493d4ecb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:29.577070 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-e3e8c7a6-74b5-4bb6-b293-f8ea493d4ecb service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.1479485 Nov 08 04:18:29.584377 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-703381'] for router_interface, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:29.640677 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:29.707384 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-ed80c619-c1e4-4a7b-8520-672e4f1ef437 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 999 time: 0.1210785 Nov 08 04:18:29.865220 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-3b0e3480-658b-4d41-b703-2d5a541857dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:29.866696 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-3b0e3480-658b-4d41-b703-2d5a541857dd service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.1448767 Nov 08 04:18:29.882535 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '00ce2f97-4322-45b8-8cd1-e53e8e1e43b6', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:24:43:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:18:28Z', 'updated_at': '2021-11-08T04:18:28Z', 'revision_number': 0, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:29.909219 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-180ec43c-7b39-49ed-bf39-de9d48e6cf93 None None] The sync data for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi is: [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '00ce2f97-4322-45b8-8cd1-e53e8e1e43b6', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:24:43:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:18:28Z', 'updated_at': '2021-11-08T04:18:28Z', 'revision_number': 0, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:18:29.939312 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-e6e2a297-1986-4870-a5a6-5b82ec28013b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:29.940784 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-e6e2a297-1986-4870-a5a6-5b82ec28013b service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0637333 Nov 08 04:18:30.081917 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-46742ff1-013c-40c3-9dda-858129d55cb3 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1217740 Nov 08 04:18:30.086809 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] Deleting port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:30.087139 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:30.105154 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 0afc78c5-30fe-44b8-be25-b6544e0efa0e no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:30.114118 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97c8650b-a647-4782-bc66-f1356d757cd3 None None] New status for floating IP 00ce2f97-4322-45b8-8cd1-e53e8e1e43b6: ACTIVE {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:18:30.129729 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: 0afc78c5-30fe-44b8-be25-b6544e0efa0e {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:30.130105 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 0afc78c5-30fe-44b8-be25-b6544e0efa0e not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:30.239737 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] For port f8d2bcad-96e3-44ea-b4e9-0ae6561bb929, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=f8d2bcad-96e3-44ea-b4e9-0ae6561bb929,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:30.240122 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:30.256606 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dcf0c73-851e-4d7c-8702-af369f7bc836 req-bd11eabb-e192-4150-8fb2-044d8b45c908 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1570735 Nov 08 04:18:30.260170 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] Calling delete_port for f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 owned by network:router_interface {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:30.506634 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:30.533119 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] Pushing event deleted for resources: {'Port': ['ID=f8d2bcad-96e3-44ea-b4e9-0ae6561bb929,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:30.693266 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530978', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-703013'] for router_interface, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:31.153529 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] Router b957ebf8-7cce-4f10-a834-1069f67f87ec has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:18:31.259927 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:18:31.265435 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-ce9b3ba9-e2f5-471e-b0ca-1a27c7320c3d admin admin] 10.222.0.21 "PUT /v2.0/routers/b957ebf8-7cce-4f10-a834-1069f67f87ec/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2059875 Nov 08 04:18:31.267995 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58036) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:31.269552 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] Sync routers for ids ['b957ebf8-7cce-4f10-a834-1069f67f87ec'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:18:31.280462 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] Routers {'b957ebf8-7cce-4f10-a834-1069f67f87ec'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:31.281471 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b957ebf8-7cce-4f10-a834-1069f67f87ec'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:31.374088 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Publish callbacks [] for router, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:31.389183 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] Set router b957ebf8-7cce-4f10-a834-1069f67f87ec gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:31.481205 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:31.636287 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Deleting port b4251616-5532-4f50-a022-45771944479c {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:31.636707 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:31.686075 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172'}], 'enable_snat': True}, 'gw_port_id': 'b4251616-5532-4f50-a022-45771944479c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:18:30Z', 'revision_number': 5, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port': {'id': 'b4251616-5532-4f50-a022-45771944479c', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:c1:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:27Z', 'updated_at': '2021-11-08T04:15:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:31.711856 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] Checking router: b957ebf8-7cce-4f10-a834-1069f67f87ec for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:18:31.720290 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] Routers {'b957ebf8-7cce-4f10-a834-1069f67f87ec'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:31.720846 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b957ebf8-7cce-4f10-a834-1069f67f87ec'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:31.721086 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] For port b4251616-5532-4f50-a022-45771944479c, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=b4251616-5532-4f50-a022-45771944479c,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:31.721807 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:31.741659 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Calling delete_port for b4251616-5532-4f50-a022-45771944479c owned by network:router_gateway {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:31.806854 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] Set router b957ebf8-7cce-4f10-a834-1069f67f87ec gateway port host: None {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:31.858719 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:18:31Z', 'revision_number': 6, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port_host': None}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:31.884767 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c16dd35-329a-40bd-8233-57dff73ef53a None None] The sync data for ids ['b957ebf8-7cce-4f10-a834-1069f67f87ec'] in dv-cinder-783643-4-iscsi is: [{'id': 'b957ebf8-7cce-4f10-a834-1069f67f87ec', 'name': 'tempest-TestMinimumBasicScenario-1725591233-router', 'tenant_id': 'd23a714c188845279fa19f9c87df4def', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:26Z', 'updated_at': '2021-11-08T04:18:31Z', 'revision_number': 6, 'project_id': 'd23a714c188845279fa19f9c87df4def', 'gw_port_host': None}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:18:31.957974 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:31.986597 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Pushing event deleted for resources: {'Port': ['ID=b4251616-5532-4f50-a022-45771944479c,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:32.045850 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-688863'] for router_gateway, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.145071 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-700541', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7524'] for router, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.147174 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.311990 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-700518'] for router, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.312592 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b957ebf8-7cce-4f10-a834-1069f67f87ec {{(pid=101665) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 04:18:32.317370 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] Publish callbacks [] for router, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.318611 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b5901397-0b76-4089-bb43-86d83f507789 admin admin] 10.222.0.21 "DELETE /v2.0/routers/b957ebf8-7cce-4f10-a834-1069f67f87ec HTTP/1.1" status: 204 len: 168 time: 1.0496523 Nov 08 04:18:32.321130 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58042) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:32.364516 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_v2 [None req-25b5504b-628d-4ae8-b1f5-2ee50b2ee807 admin admin] Deleting subnet 80d1402e-d73c-4668-9cb6-646683e6398f {{(pid=101665) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:18:32.367571 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-25b5504b-628d-4ae8-b1f5-2ee50b2ee807 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.400451 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-25b5504b-628d-4ae8-b1f5-2ee50b2ee807 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4636238'] for subnet, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.505170 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-25b5504b-628d-4ae8-b1f5-2ee50b2ee807 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.655167 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-25b5504b-628d-4ae8-b1f5-2ee50b2ee807 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6273036', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4372241'] for subnet, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.682951 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-25b5504b-628d-4ae8-b1f5-2ee50b2ee807 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.688568 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-25b5504b-628d-4ae8-b1f5-2ee50b2ee807 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/80d1402e-d73c-4668-9cb6-646683e6398f HTTP/1.1" status: 204 len: 168 time: 0.3641117 Nov 08 04:18:32.688568 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25b5504b-628d-4ae8-b1f5-2ee50b2ee807 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=80d1402e-d73c-4668-9cb6-646683e6398f,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:32.690086 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58046) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:32.692771 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-148622f4-8933-4d39-befa-8c698a95fd5f None None] Network 92ef9e7b-7c26-4986-b683-d2777b2485f6 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:18:32.766717 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.821490 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Deleting port 06bebe1b-7cac-4835-a79d-70f62c97c067 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:32.821924 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.896539 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-514383d5-ec59-47e8-8207-4dc2753343bb None None] DHCP port deletion for 92ef9e7b-7c26-4986-b683-d2777b2485f6 request from dv-cinder-783643-4-iscsi {{(pid=101666) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 04:18:32.896895 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] For port 06bebe1b-7cac-4835-a79d-70f62c97c067, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=06bebe1b-7cac-4835-a79d-70f62c97c067,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:32.897116 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:32.911194 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Calling delete_port for 06bebe1b-7cac-4835-a79d-70f62c97c067 owned by network:dhcp {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:32.943576 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-514383d5-ec59-47e8-8207-4dc2753343bb None None] Deleting port 06bebe1b-7cac-4835-a79d-70f62c97c067 {{(pid=101666) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:32.943977 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-514383d5-ec59-47e8-8207-4dc2753343bb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:33.009210 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-514383d5-ec59-47e8-8207-4dc2753343bb None None] For port 06bebe1b-7cac-4835-a79d-70f62c97c067, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=06bebe1b-7cac-4835-a79d-70f62c97c067,segment=NetworkSegment(86bea8b1-4216-4683-8a95-512bc8c9bcac),segment_id=86bea8b1-4216-4683-8a95-512bc8c9bcac)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:33.009605 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-514383d5-ec59-47e8-8207-4dc2753343bb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:33.021572 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-514383d5-ec59-47e8-8207-4dc2753343bb None None] Calling delete_port for 06bebe1b-7cac-4835-a79d-70f62c97c067 owned by network:dhcp {{(pid=101666) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:33.117830 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:33.134656 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-514383d5-ec59-47e8-8207-4dc2753343bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522'] for port, after_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:33.145020 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Pushing event deleted for resources: {'Port': ['ID=06bebe1b-7cac-4835-a79d-70f62c97c067,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:33.146869 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] No DVR routers for this DVR port 06bebe1b-7cac-4835-a79d-70f62c97c067 on host dv-cinder-783643-4-iscsi {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:18:33.166123 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-514383d5-ec59-47e8-8207-4dc2753343bb None None] No DVR routers for this DVR port 06bebe1b-7cac-4835-a79d-70f62c97c067 on host dv-cinder-783643-4-iscsi {{(pid=101666) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:18:33.171791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514383d5-ec59-47e8-8207-4dc2753343bb None None] Pushing event deleted for resources: {'Port': ['ID=06bebe1b-7cac-4835-a79d-70f62c97c067,revision_number=None']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:33.226831 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:33.249923 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['92ef9e7b-7c26-4986-b683-d2777b2485f6']}} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:33.255121 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device b4251616-5532-4f50-a022-45771944479c no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:33.264663 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '86bea8b1-4216-4683-8a95-512bc8c9bcac') {'for_net_delete': True} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:33.265863 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '86bea8b1-4216-4683-8a95-512bc8c9bcac') {} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:33.274897 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: b4251616-5532-4f50-a022-45771944479c {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:33.275302 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device b4251616-5532-4f50-a022-45771944479c not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:33.275486 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4636247'] for segment, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:33.275719 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:33.288698 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:33.294818 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:33.295162 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device f8d2bcad-96e3-44ea-b4e9-0ae6561bb929 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:33.295321 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Releasing vlan 150 on physical network physnet1 to pool {{(pid=101665) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:18:33.295565 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 06bebe1b-7cac-4835-a79d-70f62c97c067 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:33.295678 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6273258'] for segment, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: Traceback (most recent call last): Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: timer() Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: cb(*args, **kw) Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: return func(*args, **kwargs) Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: self._notify() Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: self.callback(batched_events) Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: event.method(event) Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: return f(self, *a, **k) Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._get(url).json() Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: return self.request(url, 'GET', **kwargs) Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:18:33.297281 dv-cinder-783643-4-iscsi neutron-server[101665]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:18:33.317159 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 06bebe1b-7cac-4835-a79d-70f62c97c067 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:33.317498 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 06bebe1b-7cac-4835-a79d-70f62c97c067 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:33.397425 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:33.402585 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:33.405723 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] 10.222.0.21 "DELETE /v2.0/networks/92ef9e7b-7c26-4986-b683-d2777b2485f6 HTTP/1.1" status: 204 len: 168 time: 0.7146835 Nov 08 04:18:33.408704 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58048) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:33.418938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e67b13b-70ce-4156-92cb-52be0608857a admin admin] Pushing event deleted for resources: {'Network': ['ID=92ef9e7b-7c26-4986-b683-d2777b2485f6,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:33.746445 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-703381'] for router_interface, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:34.000730 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] Deleting port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:34.001077 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:34.078596 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] For port f6bbfa98-8445-4ae3-88e8-d9c876db8ebe, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=f6bbfa98-8445-4ae3-88e8-d9c876db8ebe,segment=NetworkSegment(0b48935c-b047-416c-af65-64437316f0d9),segment_id=0b48935c-b047-416c-af65-64437316f0d9)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:34.078978 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:34.091116 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] Calling delete_port for f6bbfa98-8445-4ae3-88e8-d9c876db8ebe owned by network:router_interface {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:34.340194 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:34.363568 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] Pushing event deleted for resources: {'Port': ['ID=f6bbfa98-8445-4ae3-88e8-d9c876db8ebe,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:34.528714 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530978', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-703013'] for router_interface, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:34.736964 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] Router b550b3e0-0c49-4c38-a462-686bd574fc26 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:18:35.083476 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:18:35.089101 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-5d70ec98-698b-4c19-acb6-2dda2438adb5 admin admin] 10.222.0.21 "PUT /v2.0/routers/b550b3e0-0c49-4c38-a462-686bd574fc26/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6788025 Nov 08 04:18:35.092020 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58064) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:35.093968 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] Sync routers for ids ['b550b3e0-0c49-4c38-a462-686bd574fc26'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:18:35.105239 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] Routers {'b550b3e0-0c49-4c38-a462-686bd574fc26'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:35.105910 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b550b3e0-0c49-4c38-a462-686bd574fc26'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:35.213869 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] Set router b550b3e0-0c49-4c38-a462-686bd574fc26 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:35.230071 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Publish callbacks [] for router, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:35.338961 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:35.387708 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'name': 'tempest-TestMinimumBasicScenario-1631031505-router', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:35Z', 'updated_at': '2021-11-08T04:18:34Z', 'revision_number': 5, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'gw_port': {'id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:25:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:36Z', 'updated_at': '2021-11-08T04:15:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:35.412182 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] Checking router: b550b3e0-0c49-4c38-a462-686bd574fc26 for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:18:35.420592 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] Routers {'b550b3e0-0c49-4c38-a462-686bd574fc26'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:35.421153 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['b550b3e0-0c49-4c38-a462-686bd574fc26'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:35.497214 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Deleting port 4ce6477b-bc02-4335-b9e3-5322241456eb {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:35.497553 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:35.522051 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] Set router b550b3e0-0c49-4c38-a462-686bd574fc26 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:35.574257 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] For port 4ce6477b-bc02-4335-b9e3-5322241456eb, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=4ce6477b-bc02-4335-b9e3-5322241456eb,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:35.576941 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:35.587813 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Calling delete_port for 4ce6477b-bc02-4335-b9e3-5322241456eb owned by network:router_gateway {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:35.693960 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'name': 'tempest-TestMinimumBasicScenario-1631031505-router', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:35Z', 'updated_at': '2021-11-08T04:18:34Z', 'revision_number': 5, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'gw_port': {'id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:25:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:36Z', 'updated_at': '2021-11-08T04:15:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:35.719227 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-758e3f8e-b48a-4afb-bc74-b2f617a81618 None None] The sync data for ids ['b550b3e0-0c49-4c38-a462-686bd574fc26'] in dv-cinder-783643-4-iscsi is: [{'id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'name': 'tempest-TestMinimumBasicScenario-1631031505-router', 'tenant_id': '5550d3215c604df0a8d8690af521cbb2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:15:35Z', 'updated_at': '2021-11-08T04:18:34Z', 'revision_number': 5, 'project_id': '5550d3215c604df0a8d8690af521cbb2', 'gw_port': {'id': '4ce6477b-bc02-4335-b9e3-5322241456eb', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:24:25:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b550b3e0-0c49-4c38-a462-686bd574fc26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 423, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:15:36Z', 'updated_at': '2021-11-08T04:15:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:18:35.803864 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:35.827453 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Pushing event deleted for resources: {'Port': ['ID=4ce6477b-bc02-4335-b9e3-5322241456eb,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:35.891518 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-688863'] for router_gateway, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:35.978364 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-700541', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7524'] for router, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:35.981047 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.077750 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-700518'] for router, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.078316 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b550b3e0-0c49-4c38-a462-686bd574fc26 {{(pid=101664) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 04:18:36.083432 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.084596 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-9aa8c556-03dc-46b3-8ffb-119a60471063 admin admin] 10.222.0.21 "DELETE /v2.0/routers/b550b3e0-0c49-4c38-a462-686bd574fc26 HTTP/1.1" status: 204 len: 168 time: 0.9916282 Nov 08 04:18:36.087153 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58066) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:36.137208 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_v2 [None req-30fb00d5-a789-49bf-97eb-b69613c3e2ee admin admin] Deleting subnet abb984ac-8c1e-423f-8584-f542a644ade9 {{(pid=101664) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:18:36.140462 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-30fb00d5-a789-49bf-97eb-b69613c3e2ee admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.177113 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-30fb00d5-a789-49bf-97eb-b69613c3e2ee admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6285890'] for subnet, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.294940 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-30fb00d5-a789-49bf-97eb-b69613c3e2ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.426743 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-30fb00d5-a789-49bf-97eb-b69613c3e2ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5121021', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5043596'] for subnet, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.478747 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30fb00d5-a789-49bf-97eb-b69613c3e2ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=abb984ac-8c1e-423f-8584-f542a644ade9,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:36.478747 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-30fb00d5-a789-49bf-97eb-b69613c3e2ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.478747 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-30fb00d5-a789-49bf-97eb-b69613c3e2ee admin admin] 10.222.0.21 "DELETE /v2.0/subnets/abb984ac-8c1e-423f-8584-f542a644ade9 HTTP/1.1" status: 204 len: 168 time: 0.3699925 Nov 08 04:18:36.479592 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7dc2dc5b-44a0-4dea-9b88-07ba344219b8 None None] Network 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:18:36.480049 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58082) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:36.550871 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.608126 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Deleting port 0fc5f8ba-8da4-429f-903e-274bd4316a60 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:36.608788 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.673426 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] For port 0fc5f8ba-8da4-429f-903e-274bd4316a60, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0fc5f8ba-8da4-429f-903e-274bd4316a60,segment=NetworkSegment(0b48935c-b047-416c-af65-64437316f0d9),segment_id=0b48935c-b047-416c-af65-64437316f0d9)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:36.673701 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.685552 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Calling delete_port for 0fc5f8ba-8da4-429f-903e-274bd4316a60 owned by network:dhcp {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:36.724018 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfc70c77-668d-444f-b40d-83a4232b96e8 None None] DHCP port deletion for 473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd request from dv-cinder-783643-4-iscsi {{(pid=101666) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 04:18:36.780085 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-bfc70c77-668d-444f-b40d-83a4232b96e8 None None] Deleting port 0fc5f8ba-8da4-429f-903e-274bd4316a60 {{(pid=101666) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:36.780496 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bfc70c77-668d-444f-b40d-83a4232b96e8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.824502 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.846424 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-bfc70c77-668d-444f-b40d-83a4232b96e8 None None] For port 0fc5f8ba-8da4-429f-903e-274bd4316a60, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0fc5f8ba-8da4-429f-903e-274bd4316a60,segment=NetworkSegment(0b48935c-b047-416c-af65-64437316f0d9),segment_id=0b48935c-b047-416c-af65-64437316f0d9)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:36.846843 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bfc70c77-668d-444f-b40d-83a4232b96e8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.850547 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Pushing event deleted for resources: {'Port': ['ID=0fc5f8ba-8da4-429f-903e-274bd4316a60,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:36.854203 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] No DVR routers for this DVR port 0fc5f8ba-8da4-429f-903e-274bd4316a60 on host dv-cinder-783643-4-iscsi {{(pid=101664) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:18:36.862496 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-bfc70c77-668d-444f-b40d-83a4232b96e8 None None] Calling delete_port for 0fc5f8ba-8da4-429f-903e-274bd4316a60 owned by network:dhcp {{(pid=101666) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:36.930305 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.951575 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bfc70c77-668d-444f-b40d-83a4232b96e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522'] for port, after_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.953974 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd']}} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:36.964708 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0b48935c-b047-416c-af65-64437316f0d9') {'for_net_delete': True} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:36.965094 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0b48935c-b047-416c-af65-64437316f0d9') {} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:36.975707 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6285915'] for segment, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:36.976609 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc70c77-668d-444f-b40d-83a4232b96e8 None None] Pushing event deleted for resources: {'Port': ['ID=0fc5f8ba-8da4-429f-903e-274bd4316a60,revision_number=None']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:36.980413 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfc70c77-668d-444f-b40d-83a4232b96e8 None None] No DVR routers for this DVR port 0fc5f8ba-8da4-429f-903e-274bd4316a60 on host dv-cinder-783643-4-iscsi {{(pid=101666) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:18:36.982857 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac5cc0d-563c-4bb3-93d5-04fd21fa6db7 req-9bfed47a-3f89-42d2-8ec9-95e29d3893f6 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:36.992298 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ac5cc0d-563c-4bb3-93d5-04fd21fa6db7 req-9bfed47a-3f89-42d2-8ec9-95e29d3893f6 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 946 time: 0.0598218 Nov 08 04:18:36.999153 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:37.002791 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Releasing vlan 177 on physical network physnet1 to pool {{(pid=101664) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:18:37.003176 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5120795'] for segment, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: Traceback (most recent call last): Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: timer() Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: cb(*args, **kw) Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: return func(*args, **kwargs) Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: self._notify() Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: self.callback(batched_events) Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: event.method(event) Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: return f(self, *a, **k) Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._get(url).json() Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: return self.request(url, 'GET', **kwargs) Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:18:37.004834 dv-cinder-783643-4-iscsi neutron-server[101664]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:18:37.034724 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ac5cc0d-563c-4bb3-93d5-04fd21fa6db7 req-0be6e65c-9a54-42b5-a477-051eeb6891ec tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0419116 Nov 08 04:18:37.111982 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:37.117277 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:37.123546 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] 10.222.0.21 "DELETE /v2.0/networks/473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd HTTP/1.1" status: 204 len: 168 time: 0.6457479 Nov 08 04:18:37.132251 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4cddddd-cd9a-4d78-9642-884286484fe4 admin admin] Pushing event deleted for resources: {'Network': ['ID=473b4e69-ca6a-4ce4-8305-cdc9c16e5fbd,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:37.240739 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device f6bbfa98-8445-4ae3-88e8-d9c876db8ebe no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:37.266944 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: f6bbfa98-8445-4ae3-88e8-d9c876db8ebe {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:37.267205 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device f6bbfa98-8445-4ae3-88e8-d9c876db8ebe not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:37.267616 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 4ce6477b-bc02-4335-b9e3-5322241456eb no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:37.285747 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 4ce6477b-bc02-4335-b9e3-5322241456eb {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:37.288484 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 4ce6477b-bc02-4335-b9e3-5322241456eb not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:37.288484 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0fc5f8ba-8da4-429f-903e-274bd4316a60 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:37.304669 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 0fc5f8ba-8da4-429f-903e-274bd4316a60 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:37.306713 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0fc5f8ba-8da4-429f-903e-274bd4316a60 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:37.402337 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58094) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:37.444972 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-56bd8f98-7644-41db-848d-238614d79879 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=d23a714c188845279fa19f9c87df4def&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0413415 Nov 08 04:18:37.447236 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58096) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:37.492849 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fde94cd4-b95b-45c4-b7e7-61719ffd0dd0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:37.513315 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fde94cd4-b95b-45c4-b7e7-61719ffd0dd0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:37.597744 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fde94cd4-b95b-45c4-b7e7-61719ffd0dd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:37.600506 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fde94cd4-b95b-45c4-b7e7-61719ffd0dd0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:37.601644 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-fde94cd4-b95b-45c4-b7e7-61719ffd0dd0 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/125bb1c5-4045-423e-afc6-df481c0f781b HTTP/1.1" status: 204 len: 168 time: 0.1534905 Nov 08 04:18:37.610454 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fde94cd4-b95b-45c4-b7e7-61719ffd0dd0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=125bb1c5-4045-423e-afc6-df481c0f781b,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:38.148908 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23e97a91-cd49-42f5-aeb3-2b99cf29ff30 req-dd2fb669-1e12-4532-9f98-4c58ad83c922 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:38.150404 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-23e97a91-cd49-42f5-aeb3-2b99cf29ff30 req-dd2fb669-1e12-4532-9f98-4c58ad83c922 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 946 time: 0.0477061 Nov 08 04:18:38.176788 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58104) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:38.224322 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-23e97a91-cd49-42f5-aeb3-2b99cf29ff30 req-47257649-535e-4269-9a76-ba780cdaf39a tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0671086 Nov 08 04:18:38.238307 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-36ae6528-a4df-4036-b147-ff076f07515b admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=5550d3215c604df0a8d8690af521cbb2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0604305 Nov 08 04:18:38.240799 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58106) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:38.287139 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c8af76a1-fe13-476f-b615-cc2b49a69b87 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:38.308191 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c8af76a1-fe13-476f-b615-cc2b49a69b87 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:38.408949 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c8af76a1-fe13-476f-b615-cc2b49a69b87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:38.411438 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c8af76a1-fe13-476f-b615-cc2b49a69b87 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:38.412553 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-c8af76a1-fe13-476f-b615-cc2b49a69b87 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/83c49cf5-ff43-473c-85d0-7f2b92def0e1 HTTP/1.1" status: 204 len: 168 time: 0.1708837 Nov 08 04:18:38.420338 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8af76a1-fe13-476f-b615-cc2b49a69b87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83c49cf5-ff43-473c-85d0-7f2b92def0e1,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:39.222055 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-45ed33e0-77fd-4da3-907a-02de29f7a5ac tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:39.223504 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-45ed33e0-77fd-4da3-907a-02de29f7a5ac tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.16 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 946 time: 0.0515366 Nov 08 04:18:39.352388 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf337a76-ef85-4940-b772-8d39f4adbd77 req-eafccb51-4028-4c30-b77b-3d982d566b63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:39.354457 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bf337a76-ef85-4940-b772-8d39f4adbd77 req-eafccb51-4028-4c30-b77b-3d982d566b63 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 946 time: 0.0604732 Nov 08 04:18:39.357181 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Deleting port 2abd6ef0-1ecd-43cd-a09b-789090304b54 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:39.357771 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:39.466924 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bf337a76-ef85-4940-b772-8d39f4adbd77 req-83476a6d-8bcb-4dd7-8a0a-65d15b0be9ba tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups?id=e7f67058-ad3f-4237-9829-4b107e4dea1c&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0970168 Nov 08 04:18:39.476030 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] For port 2abd6ef0-1ecd-43cd-a09b-789090304b54, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=2abd6ef0-1ecd-43cd-a09b-789090304b54,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:39.476381 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:39.640795 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:39.641148 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:39.641461 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Floating IP 9d8caa52-e595-4dfa-81af-5002d8042e90 disassociated. External IP: 172.27.2.86, port: 2abd6ef0-1ecd-43cd-a09b-789090304b54. Nov 08 04:18:39.641796 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Calling delete_port for 2abd6ef0-1ecd-43cd-a09b-789090304b54 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:39.797652 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:39.829420 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event deleted for resources: {'Port': ['ID=2abd6ef0-1ecd-43cd-a09b-789090304b54,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:39.941723 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Router 38c2ccdd-af72-475c-872c-b75630dd8639 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:18:40.044865 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:18:40.055373 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] Sync routers for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:18:40.065504 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:40.066103 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:40.082445 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] No DVR routers for this DVR port 2abd6ef0-1ecd-43cd-a09b-789090304b54 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:18:40.084908 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:40.088218 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a17a8395-cf39-4985-bf5b-6730340edfe7 req-d1a78d9a-62d4-475d-b36a-d7c9f432e06b tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.16 "DELETE /v2.0/ports/2abd6ef0-1ecd-43cd-a09b-789090304b54 HTTP/1.1" status: 204 len: 173 time: 0.8563790 Nov 08 04:18:40.088665 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'name': 'network-vif-deleted', 'tag': '2abd6ef0-1ecd-43cd-a09b-789090304b54'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:18:40.090907 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2531ae3-573d-4bc2-8e18-d4db376257e8" -d '{"events": [{"server_uuid": "783afda2-d37a-42f5-a3b3-d2f0b3cde4ca", "name": "network-vif-deleted", "tag": "2abd6ef0-1ecd-43cd-a09b-789090304b54"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:18:40.131241 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:18:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8d4b65ff-08a3-413f-ac57-0ce48af5109d x-openstack-request-id: req-8d4b65ff-08a3-413f-ac57-0ce48af5109d {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:18:40.131535 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "783afda2-d37a-42f5-a3b3-d2f0b3cde4ca", "name": "network-vif-deleted", "tag": "2abd6ef0-1ecd-43cd-a09b-789090304b54", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:18:40.134277 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-8d4b65ff-08a3-413f-ac57-0ce48af5109d {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:18:40.134277 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '783afda2-d37a-42f5-a3b3-d2f0b3cde4ca', 'name': 'network-vif-deleted', 'tag': '2abd6ef0-1ecd-43cd-a09b-789090304b54', 'status': 'completed', 'code': 200} Nov 08 04:18:40.176764 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:40.502691 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:40.529281 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] Checking router: 38c2ccdd-af72-475c-872c-b75630dd8639 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:18:40.537901 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:40.538551 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:40.566418 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-15fa9720-4c55-411e-83c3-858144d11498 req-acc26f70-4a4e-4d23-8ce3-3e02e15e1b70 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/ports?device_id=783afda2-d37a-42f5-a3b3-d2f0b3cde4ca HTTP/1.1" status: 200 len: 210 time: 0.0290279 Nov 08 04:18:40.646381 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:40.840563 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:40.865569 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb9b6cb-d493-4519-8ac7-f80077717fe9 None None] The sync data for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi is: [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:25Z', 'revision_number': 4, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '391cb1a2-87e0-4676-80f5-f6a5a4ed3c83', 'name': '', 'network_id': 'bd0479b2-da8e-41bd-929c-b9ece4aaa29f', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'mac_address': 'fa:16:3e:0d:bb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:35Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'subnets': [{'id': '1158e941-c129-49d0-9b8b-ba72d0ef6717', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:18:41.071577 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9703ee46-3915-4e39-b6a0-7c9365cdfa03 None None] New status for floating IP 9d8caa52-e595-4dfa-81af-5002d8042e90: DOWN {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:18:41.701034 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58122) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:41.754503 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-64df54bb-6145-4c2d-94ea-ac8e95bcf1f2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:41.778152 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-64df54bb-6145-4c2d-94ea-ac8e95bcf1f2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:41.877560 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-64df54bb-6145-4c2d-94ea-ac8e95bcf1f2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:41.880132 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-64df54bb-6145-4c2d-94ea-ac8e95bcf1f2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:41.881304 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-64df54bb-6145-4c2d-94ea-ac8e95bcf1f2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "DELETE /v2.0/security-groups/e7f67058-ad3f-4237-9829-4b107e4dea1c HTTP/1.1" status: 204 len: 168 time: 0.1792939 Nov 08 04:18:41.884223 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58124) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:41.891045 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64df54bb-6145-4c2d-94ea-ac8e95bcf1f2 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7f67058-ad3f-4237-9829-4b107e4dea1c,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:41.899662 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.api.v2.resource [None req-e6b9a7dd-51d7-4c22-8513-36fab562c832 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] show failed (client error): The resource could not be found. Nov 08 04:18:41.900734 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e6b9a7dd-51d7-4c22-8513-36fab562c832 tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "GET /v2.0/security-groups/e7f67058-ad3f-4237-9829-4b107e4dea1c HTTP/1.1" status: 404 len: 347 time: 0.0154610 Nov 08 04:18:41.904113 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58126) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:42.022768 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Deleting port 9b6c2cb0-851c-4427-af5d-9638a2e842f4 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:42.023100 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:42.096846 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:42.097163 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:42.108471 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Calling delete_port for 9b6c2cb0-851c-4427-af5d-9638a2e842f4 owned by network:floatingip {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:42.138178 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 2abd6ef0-1ecd-43cd-a09b-789090304b54 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:42.158758 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: 2abd6ef0-1ecd-43cd-a09b-789090304b54 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:42.159106 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 2abd6ef0-1ecd-43cd-a09b-789090304b54 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:42.294217 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:42.318752 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Pushing event deleted for resources: {'Port': ['ID=9b6c2cb0-851c-4427-af5d-9638a2e842f4,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:42.343172 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.343519 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.343861 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.344193 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.344518 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.344846 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.345170 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.345493 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.345816 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.346135 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.346451 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.346790 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:18:42.386615 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks [] for floatingip, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:42.389148 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:42.390343 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-aa750889-2a43-4021-8bdb-b374184cdfeb tempest-AttachVolumeTestJSON-1955141327 tempest-AttachVolumeTestJSON-1955141327-project] 10.222.0.21 "DELETE /v2.0/floatingips/9d8caa52-e595-4dfa-81af-5002d8042e90 HTTP/1.1" status: 204 len: 168 time: 0.4853094 Nov 08 04:18:42.643519 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-efb03b21-713d-4430-ac13-9917c77d250c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:45.140753 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7753e778-928c-4ee7-9343-1b2c907f4f14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:45.969084 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:18:45.974832 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:46.298847 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58154) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:46.812344 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-703381'] for router_interface, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:47.044155 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] Deleting port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:47.044486 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:47.117547 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] For port 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=391cb1a2-87e0-4676-80f5-f6a5a4ed3c83,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:47.117851 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:47.130233 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] Calling delete_port for 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 owned by network:router_interface {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:47.346385 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:47.375823 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] Pushing event deleted for resources: {'Port': ['ID=391cb1a2-87e0-4676-80f5-f6a5a4ed3c83,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:47.586806 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:47.788426 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530978', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-703013'] for router_interface, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:47.991984 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] Router 38c2ccdd-af72-475c-872c-b75630dd8639 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:18:48.092155 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:18:48.097918 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-d9cd7af3-8f2f-4b5f-90d8-34468ea70bef admin admin] 10.222.0.21 "PUT /v2.0/routers/38c2ccdd-af72-475c-872c-b75630dd8639/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7980015 Nov 08 04:18:48.099767 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58160) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:48.102303 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] Sync routers for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:18:48.112616 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:48.113225 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:48.200618 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Publish callbacks [] for router, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:48.218171 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:48.298426 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:48.386773 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Deleting port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:48.387430 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:48.387537 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:48.405415 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101'}], 'enable_snat': True}, 'gw_port_id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:18:47Z', 'revision_number': 5, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port': {'id': '2d9dbcc2-e0b8-432f-805e-9d60c35596e4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a0:41:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:19Z', 'updated_at': '2021-11-08T04:11:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:48.435245 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] Checking router: 38c2ccdd-af72-475c-872c-b75630dd8639 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:18:48.443394 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] Routers {'38c2ccdd-af72-475c-872c-b75630dd8639'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:18:48.444007 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['38c2ccdd-af72-475c-872c-b75630dd8639'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:48.464715 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] For port 2d9dbcc2-e0b8-432f-805e-9d60c35596e4, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=2d9dbcc2-e0b8-432f-805e-9d60c35596e4,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:48.465095 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:48.477945 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Calling delete_port for 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 owned by network:router_gateway {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:48.528429 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] Set router 38c2ccdd-af72-475c-872c-b75630dd8639 gateway port host: None {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:18:48.579118 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:18:48Z', 'revision_number': 6, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port_host': None}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:48.609007 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a17ff734-e025-4f19-9f9a-a3f0b6296d3b None None] The sync data for ids ['38c2ccdd-af72-475c-872c-b75630dd8639'] in dv-cinder-783643-4-iscsi is: [{'id': '38c2ccdd-af72-475c-872c-b75630dd8639', 'name': 'tempest-AttachVolumeTestJSON-1483896956-router', 'tenant_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:18:48Z', 'revision_number': 6, 'project_id': 'ebd67f9cc3964c7bbc45974e8833edd2', 'gw_port_host': None}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:18:48.706116 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:48.729117 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Pushing event deleted for resources: {'Port': ['ID=2d9dbcc2-e0b8-432f-805e-9d60c35596e4,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:48.798715 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-688863'] for router_gateway, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:48.885794 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-700541', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7524'] for router, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:48.887969 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.003542 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-700518'] for router, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.004210 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 38c2ccdd-af72-475c-872c-b75630dd8639 {{(pid=101664) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 04:18:49.008547 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.010298 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-132a10fa-82e5-4304-b5fd-c3c530fde554 admin admin] 10.222.0.21 "DELETE /v2.0/routers/38c2ccdd-af72-475c-872c-b75630dd8639 HTTP/1.1" status: 204 len: 168 time: 0.9089949 Nov 08 04:18:49.012256 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58162) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:49.057743 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_v2 [None req-a5f1f09c-a280-4899-b8ff-758b5ff624bb admin admin] Deleting subnet 1158e941-c129-49d0-9b8b-ba72d0ef6717 {{(pid=101664) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:18:49.060969 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a5f1f09c-a280-4899-b8ff-758b5ff624bb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.097775 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a5f1f09c-a280-4899-b8ff-758b5ff624bb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6285890'] for subnet, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.194828 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a5f1f09c-a280-4899-b8ff-758b5ff624bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.306507 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a5f1f09c-a280-4899-b8ff-758b5ff624bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5121021', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5043596'] for subnet, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.335325 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5f1f09c-a280-4899-b8ff-758b5ff624bb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1158e941-c129-49d0-9b8b-ba72d0ef6717,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:49.339535 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a5f1f09c-a280-4899-b8ff-758b5ff624bb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.345377 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58164) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:49.346667 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-504611d4-c02d-437f-b9fd-2a85e3085d14 None None] Network bd0479b2-da8e-41bd-929c-b9ece4aaa29f requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:18:49.353967 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a5f1f09c-a280-4899-b8ff-758b5ff624bb admin admin] 10.222.0.21 "DELETE /v2.0/subnets/1158e941-c129-49d0-9b8b-ba72d0ef6717 HTTP/1.1" status: 204 len: 168 time: 0.3405161 Nov 08 04:18:49.414286 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.464541 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:49.480087 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Deleting port be0ad184-b6ed-4693-96f3-e5167761a498 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:49.480714 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.491347 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:49.491685 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 2d9dbcc2-e0b8-432f-805e-9d60c35596e4 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:49.492122 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:49.512575 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:49.512913 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 391cb1a2-87e0-4676-80f5-f6a5a4ed3c83 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:49.548775 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] For port be0ad184-b6ed-4693-96f3-e5167761a498, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=be0ad184-b6ed-4693-96f3-e5167761a498,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:49.549185 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.574035 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Calling delete_port for be0ad184-b6ed-4693-96f3-e5167761a498 owned by network:dhcp {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:49.597814 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42d95a8c-e22c-4b5c-adc8-6c673558e7ff None None] DHCP port deletion for bd0479b2-da8e-41bd-929c-b9ece4aaa29f request from dv-cinder-783643-4-iscsi {{(pid=101666) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 04:18:49.650653 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-42d95a8c-e22c-4b5c-adc8-6c673558e7ff None None] Deleting port be0ad184-b6ed-4693-96f3-e5167761a498 {{(pid=101666) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:18:49.651602 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-42d95a8c-e22c-4b5c-adc8-6c673558e7ff None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.706475 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.719881 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-42d95a8c-e22c-4b5c-adc8-6c673558e7ff None None] For port be0ad184-b6ed-4693-96f3-e5167761a498, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=be0ad184-b6ed-4693-96f3-e5167761a498,segment=NetworkSegment(c986aa14-0950-49b8-b946-4f7a7bf09171),segment_id=c986aa14-0950-49b8-b946-4f7a7bf09171)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:18:49.720683 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-42d95a8c-e22c-4b5c-adc8-6c673558e7ff None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.732182 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Pushing event deleted for resources: {'Port': ['ID=be0ad184-b6ed-4693-96f3-e5167761a498,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:49.735950 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] No DVR routers for this DVR port be0ad184-b6ed-4693-96f3-e5167761a498 on host dv-cinder-783643-4-iscsi {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:18:49.740093 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-42d95a8c-e22c-4b5c-adc8-6c673558e7ff None None] Calling delete_port for be0ad184-b6ed-4693-96f3-e5167761a498 owned by network:dhcp {{(pid=101666) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:18:49.814725 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.817954 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-42d95a8c-e22c-4b5c-adc8-6c673558e7ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522'] for port, after_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.840366 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bd0479b2-da8e-41bd-929c-b9ece4aaa29f']}} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:49.843623 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42d95a8c-e22c-4b5c-adc8-6c673558e7ff None None] Pushing event deleted for resources: {'Port': ['ID=be0ad184-b6ed-4693-96f3-e5167761a498,revision_number=None']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:49.847657 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42d95a8c-e22c-4b5c-adc8-6c673558e7ff None None] No DVR routers for this DVR port be0ad184-b6ed-4693-96f3-e5167761a498 on host dv-cinder-783643-4-iscsi {{(pid=101666) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:18:49.851785 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c986aa14-0950-49b8-b946-4f7a7bf09171') {'for_net_delete': True} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:49.854515 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c986aa14-0950-49b8-b946-4f7a7bf09171') {} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:49.865277 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4636247'] for segment, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.878626 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.884397 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Releasing vlan 161 on physical network physnet1 to pool {{(pid=101665) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6273258'] for segment, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: Traceback (most recent call last): Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: timer() Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: cb(*args, **kw) Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: return func(*args, **kwargs) Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: self._notify() Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: self.callback(batched_events) Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: event.method(event) Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: return f(self, *a, **k) Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._get(url).json() Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: return self.request(url, 'GET', **kwargs) Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:18:49.889817 dv-cinder-783643-4-iscsi neutron-server[101665]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:18:49.986273 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.993421 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:49.995012 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] 10.222.0.21 "DELETE /v2.0/networks/bd0479b2-da8e-41bd-929c-b9ece4aaa29f HTTP/1.1" status: 204 len: 168 time: 0.6481240 Nov 08 04:18:50.005303 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dc5524f-1b2a-4b4a-a678-aba93e532bd5 admin admin] Pushing event deleted for resources: {'Network': ['ID=bd0479b2-da8e-41bd-929c-b9ece4aaa29f,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:50.270792 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58170) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:50.308935 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-70fea629-d10a-4d71-95f0-3017e0a5cf7e admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=ebd67f9cc3964c7bbc45974e8833edd2&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0370245 Nov 08 04:18:50.311358 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58172) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:50.360032 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-261b7a4e-b43b-476e-a3cd-d174d300dd57 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:50.380563 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-261b7a4e-b43b-476e-a3cd-d174d300dd57 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:50.500232 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-261b7a4e-b43b-476e-a3cd-d174d300dd57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:50.502678 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-261b7a4e-b43b-476e-a3cd-d174d300dd57 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:50.503793 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-261b7a4e-b43b-476e-a3cd-d174d300dd57 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/af334b91-f329-4196-9d62-2a02e59082c1 HTTP/1.1" status: 204 len: 168 time: 0.1915183 Nov 08 04:18:50.511486 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-261b7a4e-b43b-476e-a3cd-d174d300dd57 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af334b91-f329-4196-9d62-2a02e59082c1,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:51.241803 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device be0ad184-b6ed-4693-96f3-e5167761a498 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:18:51.262027 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: be0ad184-b6ed-4693-96f3-e5167761a498 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:18:51.262370 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device be0ad184-b6ed-4693-96f3-e5167761a498 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:18:51.372384 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58194) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:51.463019 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1924968171-network', 'tenant_id': 'aa56b16bc4ad4a1fb7bd81b278d4bb31'}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:18:51.528893 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Made reservation on behalf of aa56b16bc4ad4a1fb7bd81b278d4bb31 for: {'network': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:18:51.531115 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:51.539849 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:51.612924 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:51.666656 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:51.693565 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] vlan segment allocate from pool success with {'vlan_id': 193, 'physical_network': 'physnet1'} {{(pid=101664) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:18:51.698839 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=042994a4-1964-4903-ab93-20901640458f,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:51.705713 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:51.706052 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.db.segments_db [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Added segment 14a5dda0-21e7-40a0-b623-03f996a5eb84 of type vlan for network 6d37cb17-3682-4285-994c-5081a13b9499 Nov 08 04:18:51.744991 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:51.802885 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:51.803809 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:51.804483 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:51.868582 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] Pushing event updated for resources: {'Network': ['ID=6d37cb17-3682-4285-994c-5081a13b9499,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:51.878755 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 6d37cb17-3682-4285-994c-5081a13b9499 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:18:51.886066 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-ce138c6f-6b29-46df-b542-e485efed48c8 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.5126173 Nov 08 04:18:51.888997 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58200) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:51.893781 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Request body: {'subnet': {'network_id': '6d37cb17-3682-4285-994c-5081a13b9499', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1924968171-subnet', 'tenant_id': 'aa56b16bc4ad4a1fb7bd81b278d4bb31', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:18:51.951943 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Made reservation on behalf of aa56b16bc4ad4a1fb7bd81b278d4bb31 for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:18:51.954297 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5043309'] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:52.174863 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5120956', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5043607'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:52.228101 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Pushing event updated for resources: {'Subnet': ['ID=17ef0c24-c5d9-492b-ba6b-dd03e96a0f65,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:52.237503 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Checking segment: {'id': '14a5dda0-21e7-40a0-b623-03f996a5eb84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 193, 'network_id': '6d37cb17-3682-4285-994c-5081a13b9499'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:18:52.237875 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Network hostable DHCP agents. Network: 6d37cb17-3682-4285-994c-5081a13b9499, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:18:52.305763 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Network 6d37cb17-3682-4285-994c-5081a13b9499 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:18:52.351162 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 6d37cb17-3682-4285-994c-5081a13b9499) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:18:52.355084 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:52.355708 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:52.359768 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5bec612b-2ad1-41f7-9c4f-67c83a72f3d8 None None] Network 6d37cb17-3682-4285-994c-5081a13b9499 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:18:52.422806 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-8dcb570d-ecfb-4839-9e66-312a0a46f4ed admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.5327141 Nov 08 04:18:52.480511 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4bb6a93-d32d-4974-98bc-cc4ab76bf5a3 None None] Network 6d37cb17-3682-4285-994c-5081a13b9499 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:18:53.014926 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58216) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:53.019707 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1096312272-network', 'tenant_id': 'ee5b0e1c2da14a42a7001db7db3de718'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:18:53.071437 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Made reservation on behalf of ee5b0e1c2da14a42a7001db7db3de718 for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:18:53.073704 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.081699 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.152256 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.191929 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.217612 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] vlan segment allocate from pool success with {'vlan_id': 178, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:18:53.222707 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38e6bbbf-864a-4157-8b4c-dbcd606f6aec,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:53.230048 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.230337 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Added segment ea192a3d-aeb4-4735-998b-8cccef1dcd1a of type vlan for network 35a25c17-0a0e-4fdd-ad4a-4a59c2a62996 Nov 08 04:18:53.270844 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.334684 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.335592 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:53.336183 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.391544 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] Pushing event updated for resources: {'Network': ['ID=35a25c17-0a0e-4fdd-ad4a-4a59c2a62996,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:53.401231 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 35a25c17-0a0e-4fdd-ad4a-4a59c2a62996 details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:18:53.408167 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-22e424cf-9cc1-4629-8ea1-4a32126c9ef3 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.3921041 Nov 08 04:18:53.408378 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58218) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:53.413356 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.v2.base [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Request body: {'subnet': {'network_id': '35a25c17-0a0e-4fdd-ad4a-4a59c2a62996', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1096312272-subnet', 'tenant_id': 'ee5b0e1c2da14a42a7001db7db3de718', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101664) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:18:53.488616 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Made reservation on behalf of ee5b0e1c2da14a42a7001db7db3de718 for: {'subnet': 1} {{(pid=101664) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:18:53.490968 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5043309'] for subnet, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.694803 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5120956', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5043607'] for subnet, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.749906 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Pushing event updated for resources: {'Subnet': ['ID=064eb826-6f23-4bf8-a3c0-a5ecd4ecc670,revision_number=0']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:53.756827 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Checking segment: {'id': 'ea192a3d-aeb4-4735-998b-8cccef1dcd1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 178, 'network_id': '35a25c17-0a0e-4fdd-ad4a-4a59c2a62996'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101664) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:18:53.757189 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Network hostable DHCP agents. Network: 35a25c17-0a0e-4fdd-ad4a-4a59c2a62996, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101664) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:18:53.820239 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Network 35a25c17-0a0e-4fdd-ad4a-4a59c2a62996 is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101664) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:18:53.888590 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.base_scheduler [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 35a25c17-0a0e-4fdd-ad4a-4a59c2a62996) {{(pid=101664) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:18:53.892606 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101664) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:53.893173 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:53.898239 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93c676e8-580a-4c7f-9bc5-b0b373e95fe0 None None] Network 35a25c17-0a0e-4fdd-ad4a-4a59c2a62996 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:18:53.959993 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-966824ed-1685-4a0a-a3d5-6453ab97bf96 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.5504117 Nov 08 04:18:54.040155 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-809edefc-541c-49b9-9cff-fbe55abb3ee6 None None] Network 35a25c17-0a0e-4fdd-ad4a-4a59c2a62996 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:18:54.072527 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58222) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:54.120478 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_v2 [None req-bc79285a-bc02-4f7c-9ff3-77e8a1ce2853 admin admin] Deleting subnet 17ef0c24-c5d9-492b-ba6b-dd03e96a0f65 {{(pid=101664) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:18:54.123672 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bc79285a-bc02-4f7c-9ff3-77e8a1ce2853 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.157688 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bc79285a-bc02-4f7c-9ff3-77e8a1ce2853 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6285890'] for subnet, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.195193 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bc79285a-bc02-4f7c-9ff3-77e8a1ce2853 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.237278 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.283741 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bc79285a-bc02-4f7c-9ff3-77e8a1ce2853 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5121021', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5043596'] for subnet, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.307114 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc79285a-bc02-4f7c-9ff3-77e8a1ce2853 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=17ef0c24-c5d9-492b-ba6b-dd03e96a0f65,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:54.312996 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bc79285a-bc02-4f7c-9ff3-77e8a1ce2853 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.316192 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-bc79285a-bc02-4f7c-9ff3-77e8a1ce2853 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/17ef0c24-c5d9-492b-ba6b-dd03e96a0f65 HTTP/1.1" status: 204 len: 168 time: 0.2426212 Nov 08 04:18:54.318803 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58224) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:54.386732 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.463715 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.483001 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6d37cb17-3682-4285-994c-5081a13b9499']}} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:54.491717 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '14a5dda0-21e7-40a0-b623-03f996a5eb84') {'for_net_delete': True} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:54.492284 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '14a5dda0-21e7-40a0-b623-03f996a5eb84') {} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:54.500853 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6285915'] for segment, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.513668 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.519531 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] Releasing vlan 193 on physical network physnet1 to pool {{(pid=101664) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:18:54.519916 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5120795'] for segment, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: Traceback (most recent call last): Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: timer() Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: cb(*args, **kw) Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: return func(*args, **kwargs) Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: self._notify() Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: self.callback(batched_events) Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: event.method(event) Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: return f(self, *a, **k) Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._get(url).json() Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: return self.request(url, 'GET', **kwargs) Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:18:54.521677 dv-cinder-783643-4-iscsi neutron-server[101664]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:18:54.614635 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.620194 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.623401 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] 10.222.0.21 "DELETE /v2.0/networks/6d37cb17-3682-4285-994c-5081a13b9499 HTTP/1.1" status: 204 len: 168 time: 0.3036942 Nov 08 04:18:54.629069 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58226) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:54.634212 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab20a22a-2431-4e3f-aa44-f5b395014fd4 admin admin] Pushing event deleted for resources: {'Network': ['ID=6d37cb17-3682-4285-994c-5081a13b9499,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:54.674281 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_v2 [None req-262a5031-d1bd-4c04-be83-6c8feedfd09b admin admin] Deleting subnet 064eb826-6f23-4bf8-a3c0-a5ecd4ecc670 {{(pid=101665) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:18:54.677433 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-262a5031-d1bd-4c04-be83-6c8feedfd09b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.714378 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-262a5031-d1bd-4c04-be83-6c8feedfd09b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4636238'] for subnet, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.750415 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-262a5031-d1bd-4c04-be83-6c8feedfd09b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.855251 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-262a5031-d1bd-4c04-be83-6c8feedfd09b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6273036', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4372241'] for subnet, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.879885 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-262a5031-d1bd-4c04-be83-6c8feedfd09b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=064eb826-6f23-4bf8-a3c0-a5ecd4ecc670,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:54.883526 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-262a5031-d1bd-4c04-be83-6c8feedfd09b admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:54.887202 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-262a5031-d1bd-4c04-be83-6c8feedfd09b admin admin] 10.222.0.21 "DELETE /v2.0/subnets/064eb826-6f23-4bf8-a3c0-a5ecd4ecc670 HTTP/1.1" status: 204 len: 168 time: 0.2570798 Nov 08 04:18:54.889750 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58228) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:54.960502 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.034834 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.053308 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['35a25c17-0a0e-4fdd-ad4a-4a59c2a62996']}} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:55.062704 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ea192a3d-aeb4-4735-998b-8cccef1dcd1a') {'for_net_delete': True} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:55.062995 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ea192a3d-aeb4-4735-998b-8cccef1dcd1a') {} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:18:55.071977 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4636247'] for segment, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.085097 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.090690 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] Releasing vlan 178 on physical network physnet1 to pool {{(pid=101665) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:18:55.091060 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6273258'] for segment, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: Traceback (most recent call last): Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: timer() Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: cb(*args, **kw) Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: return func(*args, **kwargs) Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: self._notify() Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: self.callback(batched_events) Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: event.method(event) Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: return f(self, *a, **k) Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._get(url).json() Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: return self.request(url, 'GET', **kwargs) Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:18:55.092622 dv-cinder-783643-4-iscsi neutron-server[101665]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:18:55.214323 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.221197 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.224579 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] 10.222.0.21 "DELETE /v2.0/networks/35a25c17-0a0e-4fdd-ad4a-4a59c2a62996 HTTP/1.1" status: 204 len: 168 time: 0.3338993 Nov 08 04:18:55.233705 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf85d25-a887-42ba-bcf0-a16e8276d182 admin admin] Pushing event deleted for resources: {'Network': ['ID=35a25c17-0a0e-4fdd-ad4a-4a59c2a62996,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:55.579395 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58232) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:55.617524 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-966e3957-a6a6-492b-b411-06531cfb5e7a admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=aa56b16bc4ad4a1fb7bd81b278d4bb31&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0370023 Nov 08 04:18:55.620658 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58234) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:55.664381 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-77a0233a-c556-4370-b610-2e70341f1f37 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.685246 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-77a0233a-c556-4370-b610-2e70341f1f37 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.832066 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-77a0233a-c556-4370-b610-2e70341f1f37 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.834650 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-77a0233a-c556-4370-b610-2e70341f1f37 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:55.835807 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-77a0233a-c556-4370-b610-2e70341f1f37 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/042994a4-1964-4903-ab93-20901640458f HTTP/1.1" status: 204 len: 168 time: 0.2142501 Nov 08 04:18:55.844985 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a0233a-c556-4370-b610-2e70341f1f37 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=042994a4-1964-4903-ab93-20901640458f,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:56.385462 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58240) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:56.428277 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-1e9cb771-5f1f-4f02-a873-fc19c03f7d2d admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=ee5b0e1c2da14a42a7001db7db3de718&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0416591 Nov 08 04:18:56.430650 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58242) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:18:56.475796 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fd81a234-2165-4602-89d2-93a6c69f6caf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:56.497417 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fd81a234-2165-4602-89d2-93a6c69f6caf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:56.609013 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fd81a234-2165-4602-89d2-93a6c69f6caf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:56.611539 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-fd81a234-2165-4602-89d2-93a6c69f6caf admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:18:56.612660 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-fd81a234-2165-4602-89d2-93a6c69f6caf admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/38e6bbbf-864a-4157-8b4c-dbcd606f6aec HTTP/1.1" status: 204 len: 168 time: 0.1811378 Nov 08 04:18:56.620208 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd81a234-2165-4602-89d2-93a6c69f6caf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38e6bbbf-864a-4157-8b4c-dbcd606f6aec,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:18:58.495912 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1657d935-6e12-4060-bab9-8e627b17f48e req-09f3505f-ce82-4ad8-a650-cc5dbadf474b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:58.497519 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1657d935-6e12-4060-bab9-8e627b17f48e req-09f3505f-ce82-4ad8-a650-cc5dbadf474b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 947 time: 0.0495350 Nov 08 04:18:58.545511 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1657d935-6e12-4060-bab9-8e627b17f48e req-ef1050c0-2eb0-40d5-a6b6-e2218570f050 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418615 Nov 08 04:18:59.673503 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-570ed5db-cd58-4d63-ba90-79832bcf2ded req-5d19454e-7e20-4f67-9394-0e62b021be56 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:59.674955 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-570ed5db-cd58-4d63-ba90-79832bcf2ded req-5d19454e-7e20-4f67-9394-0e62b021be56 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 947 time: 0.0494153 Nov 08 04:18:59.719764 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-570ed5db-cd58-4d63-ba90-79832bcf2ded req-b89ff650-a1fe-48a1-af69-18d8190e460a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups?id=000cac17-c1e8-4274-86fc-7bc010b0203c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389321 Nov 08 04:18:59.978859 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-761e8910-1072-4763-a432-f532d293a978 req-8f0ea641-f96f-4b4a-80da-058f9913b48b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:18:59.980182 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-761e8910-1072-4763-a432-f532d293a978 req-8f0ea641-f96f-4b4a-80da-058f9913b48b tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.16 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 947 time: 0.0503814 Nov 08 04:19:00.075321 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Deleting port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:19:00.075657 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:00.425423 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] For port d29d5bf6-7687-47ca-9dbc-9c6db81cd605, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:19:00.425786 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:00.610844 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:00.611197 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:00.611643 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Floating IP d5923b86-b8b4-4333-af31-335a334d46b9 disassociated. External IP: 172.27.2.79, port: d29d5bf6-7687-47ca-9dbc-9c6db81cd605. Nov 08 04:19:00.611856 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Calling delete_port for d29d5bf6-7687-47ca-9dbc-9c6db81cd605 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:19:00.769153 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:00.800344 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event deleted for resources: {'Port': ['ID=d29d5bf6-7687-47ca-9dbc-9c6db81cd605,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9103570-ca5d-4bf1-a218-51cb1e5807b4 req-5f2c819b-aeeb-4932-ae6a-84953c71c635 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 210 time: 0.0342009 Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.839938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:00.949743 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Router 02bab738-cfe2-4e4a-8864-2604a23990ee has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:19:01.054354 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:19:01.063843 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] Sync routers for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:19:01.073389 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:19:01.073911 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:01.093846 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] No DVR routers for this DVR port d29d5bf6-7687-47ca-9dbc-9c6db81cd605 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:19:01.096511 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:01.100490 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-761e8910-1072-4763-a432-f532d293a978 req-e778fa72-41b5-4dcd-a77e-2b2d2a983c0e tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.16 "DELETE /v2.0/ports/d29d5bf6-7687-47ca-9dbc-9c6db81cd605 HTTP/1.1" status: 204 len: 173 time: 1.1144114 Nov 08 04:19:01.100943 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'name': 'network-vif-deleted', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:19:01.104545 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6523d16-f248-46b6-aacb-b3db55d00deb" -d '{"events": [{"server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "name": "network-vif-deleted", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:19:01.140711 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:19:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8ced8a7-bd05-4324-b975-7dedca03b00e x-openstack-request-id: req-d8ced8a7-bd05-4324-b975-7dedca03b00e {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:19:01.141364 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f286df1d-064c-4e97-823b-dc15dee7355c", "name": "network-vif-deleted", "tag": "d29d5bf6-7687-47ca-9dbc-9c6db81cd605", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:19:01.154020 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-d8ced8a7-bd05-4324-b975-7dedca03b00e {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:19:01.154020 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f286df1d-064c-4e97-823b-dc15dee7355c', 'name': 'network-vif-deleted', 'tag': 'd29d5bf6-7687-47ca-9dbc-9c6db81cd605', 'status': 'completed', 'code': 200} Nov 08 04:19:01.182369 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:19:01.385781 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:01.413354 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] Checking router: 02bab738-cfe2-4e4a-8864-2604a23990ee for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:19:01.420513 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:19:01.421114 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:01.529477 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:19:01.738476 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:01.765258 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c2e7998-80ef-4fb5-aa28-d15fa94323a2 None None] The sync data for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi is: [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:11:24Z', 'revision_number': 4, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': 'd1188efc-8b55-42aa-a864-2dbeb0fbe0a3', 'name': '', 'network_id': '6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'mac_address': 'fa:16:3e:38:93:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_interface', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:23Z', 'updated_at': '2021-11-08T04:11:36Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'subnets': [{'id': '20a91346-16ed-4174-9e29-b85a8dc77939', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:19:01.960926 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0359a732-8810-471e-b4c3-71c709eb5156 req-85a4d7cf-bee1-4bb7-8b57-3175074a5e89 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/ports?device_id=f286df1d-064c-4e97-823b-dc15dee7355c HTTP/1.1" status: 200 len: 210 time: 0.0305681 Nov 08 04:19:02.000498 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f9aa3a0-55cf-48d1-b49e-0cb82bf4bf3f None None] New status for floating IP d5923b86-b8b4-4333-af31-335a334d46b9: DOWN {{(pid=101666) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:19:03.100838 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58336) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:03.153903 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-79e0be47-a1b7-4363-ba69-cdac185d6ed1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:03.176672 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-79e0be47-a1b7-4363-ba69-cdac185d6ed1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:03.277452 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-79e0be47-a1b7-4363-ba69-cdac185d6ed1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:03.280042 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-79e0be47-a1b7-4363-ba69-cdac185d6ed1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:03.281188 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-79e0be47-a1b7-4363-ba69-cdac185d6ed1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "DELETE /v2.0/security-groups/000cac17-c1e8-4274-86fc-7bc010b0203c HTTP/1.1" status: 204 len: 168 time: 0.1793599 Nov 08 04:19:03.284150 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58340) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:03.290539 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79e0be47-a1b7-4363-ba69-cdac185d6ed1 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=000cac17-c1e8-4274-86fc-7bc010b0203c,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:03.297700 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.api.v2.resource [None req-eb1a60ee-b712-4975-9615-0b837229842a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] show failed (client error): The resource could not be found. Nov 08 04:19:03.298715 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-eb1a60ee-b712-4975-9615-0b837229842a tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "GET /v2.0/security-groups/000cac17-c1e8-4274-86fc-7bc010b0203c HTTP/1.1" status: 404 len: 347 time: 0.0135620 Nov 08 04:19:03.301563 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58342) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:03.418420 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-63f6e84a-24d6-4827-b091-0a34776fa474 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Deleting port e49affde-69ab-4721-9db6-92cd48161273 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:19:03.418784 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-63f6e84a-24d6-4827-b091-0a34776fa474 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:03.492465 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-63f6e84a-24d6-4827-b091-0a34776fa474 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:03.492780 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-63f6e84a-24d6-4827-b091-0a34776fa474 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:03.503913 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-63f6e84a-24d6-4827-b091-0a34776fa474 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Calling delete_port for e49affde-69ab-4721-9db6-92cd48161273 owned by network:floatingip {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:19:03.660245 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-63f6e84a-24d6-4827-b091-0a34776fa474 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:03.685769 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63f6e84a-24d6-4827-b091-0a34776fa474 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Pushing event deleted for resources: {'Port': ['ID=e49affde-69ab-4721-9db6-92cd48161273,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:03.742035 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-63f6e84a-24d6-4827-b091-0a34776fa474 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks [] for floatingip, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:03.744597 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-63f6e84a-24d6-4827-b091-0a34776fa474 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:03.745732 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-63f6e84a-24d6-4827-b091-0a34776fa474 tempest-AttachVolumeShelveTestJSON-1751682520 tempest-AttachVolumeShelveTestJSON-1751682520-project] 10.222.0.21 "DELETE /v2.0/floatingips/d5923b86-b8b4-4333-af31-335a334d46b9 HTTP/1.1" status: 204 len: 168 time: 0.4432905 Nov 08 04:19:05.153770 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d29d5bf6-7687-47ca-9dbc-9c6db81cd605 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:19:05.173071 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: d29d5bf6-7687-47ca-9dbc-9c6db81cd605 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:19:05.173415 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device d29d5bf6-7687-47ca-9dbc-9c6db81cd605 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:19:07.460861 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58390) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:07.943605 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-703381'] for router_interface, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:08.182821 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] Deleting port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:19:08.183155 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:08.263798 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] For port d1188efc-8b55-42aa-a864-2dbeb0fbe0a3, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=d1188efc-8b55-42aa-a864-2dbeb0fbe0a3,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:19:08.264089 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:08.276827 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] Calling delete_port for d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 owned by network:router_interface {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:19:08.546177 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:08.571223 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] Pushing event deleted for resources: {'Port': ['ID=d1188efc-8b55-42aa-a864-2dbeb0fbe0a3,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:08.751928 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530978', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-703013'] for router_interface, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:08.958322 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] Router 02bab738-cfe2-4e4a-8864-2604a23990ee has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:19:09.060916 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:19:09.067839 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-9426ea0f-7f13-4c1e-a23a-3578451342a4 admin admin] 10.222.0.21 "PUT /v2.0/routers/02bab738-cfe2-4e4a-8864-2604a23990ee/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6038709 Nov 08 04:19:09.068283 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58412) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:09.070959 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] Sync routers for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:19:09.081417 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:19:09.082136 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:09.169783 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Publish callbacks [] for router, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:09.184627 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:19:09.278969 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:09.362835 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133'}], 'enable_snat': True}, 'gw_port_id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:19:08Z', 'revision_number': 5, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port': {'id': '0789f50b-915f-4c46-85b3-aa1902eb4af4', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:b5:0c:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'device_owner': 'network:router_gateway', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.133', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:11:18Z', 'updated_at': '2021-11-08T04:11:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:09.389455 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] Checking router: 02bab738-cfe2-4e4a-8864-2604a23990ee for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:19:09.397676 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] Routers {'02bab738-cfe2-4e4a-8864-2604a23990ee'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:19:09.398255 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:18:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['02bab738-cfe2-4e4a-8864-2604a23990ee'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:09.415141 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Deleting port 0789f50b-915f-4c46-85b3-aa1902eb4af4 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:19:09.415480 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:09.482524 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] Set router 02bab738-cfe2-4e4a-8864-2604a23990ee gateway port host: None {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:19:09.494332 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] For port 0789f50b-915f-4c46-85b3-aa1902eb4af4, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0789f50b-915f-4c46-85b3-aa1902eb4af4,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:19:09.494773 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:09.507289 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Calling delete_port for 0789f50b-915f-4c46-85b3-aa1902eb4af4 owned by network:router_gateway {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:19:09.533293 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:19:09Z', 'revision_number': 6, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port_host': None}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:09.654961 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f91b782-1c46-46f1-9f70-933c90914faf None None] The sync data for ids ['02bab738-cfe2-4e4a-8864-2604a23990ee'] in dv-cinder-783643-4-iscsi is: [{'id': '02bab738-cfe2-4e4a-8864-2604a23990ee', 'name': 'tempest-AttachVolumeShelveTestJSON-2007576355-router', 'tenant_id': '0efb8c7b359746668b199d14191e3f09', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:11:17Z', 'updated_at': '2021-11-08T04:19:09Z', 'revision_number': 6, 'project_id': '0efb8c7b359746668b199d14191e3f09', 'gw_port_host': None}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:19:09.797520 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:09.825600 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Pushing event deleted for resources: {'Port': ['ID=0789f50b-915f-4c46-85b3-aa1902eb4af4,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:09.884875 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-688863'] for router_gateway, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.255615 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-700541', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7524'] for router, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.257776 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.340269 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-700518'] for router, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.340733 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 02bab738-cfe2-4e4a-8864-2604a23990ee {{(pid=101665) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 04:19:10.348065 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] Publish callbacks [] for router, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.348065 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-1123b252-97bf-4a2c-82cb-93c5df69887d admin admin] 10.222.0.21 "DELETE /v2.0/routers/02bab738-cfe2-4e4a-8864-2604a23990ee HTTP/1.1" status: 204 len: 168 time: 1.2774434 Nov 08 04:19:10.349409 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58428) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:10.393970 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_v2 [None req-aa740033-032b-4391-9ca7-51fd895b6b72 admin admin] Deleting subnet 20a91346-16ed-4174-9e29-b85a8dc77939 {{(pid=101664) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:19:10.397338 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa740033-032b-4391-9ca7-51fd895b6b72 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.436188 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa740033-032b-4391-9ca7-51fd895b6b72 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6285890'] for subnet, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.512007 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa740033-032b-4391-9ca7-51fd895b6b72 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.626762 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa740033-032b-4391-9ca7-51fd895b6b72 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5121021', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5043596'] for subnet, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.656288 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa740033-032b-4391-9ca7-51fd895b6b72 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=20a91346-16ed-4174-9e29-b85a8dc77939,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:10.659998 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-aa740033-032b-4391-9ca7-51fd895b6b72 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.663167 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-aa740033-032b-4391-9ca7-51fd895b6b72 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/20a91346-16ed-4174-9e29-b85a8dc77939 HTTP/1.1" status: 204 len: 168 time: 0.3127151 Nov 08 04:19:10.665674 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58430) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:10.668169 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99dfc280-e63b-4d16-8991-33e4e1cdf583 None None] Network 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:19:10.732741 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.784761 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Deleting port 495ffdd1-ff2f-4300-b636-fa1fcc35977b {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:19:10.785097 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.850260 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] For port 495ffdd1-ff2f-4300-b636-fa1fcc35977b, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=495ffdd1-ff2f-4300-b636-fa1fcc35977b,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:19:10.850676 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.857752 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14e20ffe-0a77-4dd4-bb79-51a9aa80d298 None None] DHCP port deletion for 6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e request from dv-cinder-783643-4-iscsi {{(pid=101666) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 04:19:10.864119 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Calling delete_port for 495ffdd1-ff2f-4300-b636-fa1fcc35977b owned by network:dhcp {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:19:10.902875 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-14e20ffe-0a77-4dd4-bb79-51a9aa80d298 None None] Deleting port 495ffdd1-ff2f-4300-b636-fa1fcc35977b {{(pid=101666) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:19:10.903168 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-14e20ffe-0a77-4dd4-bb79-51a9aa80d298 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.965799 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-14e20ffe-0a77-4dd4-bb79-51a9aa80d298 None None] For port 495ffdd1-ff2f-4300-b636-fa1fcc35977b, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=495ffdd1-ff2f-4300-b636-fa1fcc35977b,segment=NetworkSegment(c233b592-8fd7-4c2a-b811-110d9b226d31),segment_id=c233b592-8fd7-4c2a-b811-110d9b226d31)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:19:10.966188 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-14e20ffe-0a77-4dd4-bb79-51a9aa80d298 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:10.977951 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-14e20ffe-0a77-4dd4-bb79-51a9aa80d298 None None] Calling delete_port for 495ffdd1-ff2f-4300-b636-fa1fcc35977b owned by network:dhcp {{(pid=101666) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:19:10.980317 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.008841 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Pushing event deleted for resources: {'Port': ['ID=495ffdd1-ff2f-4300-b636-fa1fcc35977b,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:11.013092 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] No DVR routers for this DVR port 495ffdd1-ff2f-4300-b636-fa1fcc35977b on host dv-cinder-783643-4-iscsi {{(pid=101664) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:19:11.051263 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-14e20ffe-0a77-4dd4-bb79-51a9aa80d298 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522'] for port, after_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.078962 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14e20ffe-0a77-4dd4-bb79-51a9aa80d298 None None] Pushing event deleted for resources: {'Port': ['ID=495ffdd1-ff2f-4300-b636-fa1fcc35977b,revision_number=None']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:11.080309 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.082505 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14e20ffe-0a77-4dd4-bb79-51a9aa80d298 None None] No DVR routers for this DVR port 495ffdd1-ff2f-4300-b636-fa1fcc35977b on host dv-cinder-783643-4-iscsi {{(pid=101666) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:19:11.102762 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e']}} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:11.112968 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c233b592-8fd7-4c2a-b811-110d9b226d31') {'for_net_delete': True} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:11.113198 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c233b592-8fd7-4c2a-b811-110d9b226d31') {} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:19:11.122843 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6285915'] for segment, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.135499 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.141099 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Releasing vlan 184 on physical network physnet1 to pool {{(pid=101664) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:19:11.141472 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5120795'] for segment, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: Traceback (most recent call last): Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: timer() Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: cb(*args, **kw) Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: return func(*args, **kwargs) Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: self._notify() Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: self.callback(batched_events) Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: event.method(event) Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: return f(self, *a, **k) Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._get(url).json() Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: return self.request(url, 'GET', **kwargs) Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:19:11.143100 dv-cinder-783643-4-iscsi neutron-server[101664]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:19:11.249103 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.257302 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0789f50b-915f-4c46-85b3-aa1902eb4af4 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:19:11.259271 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.262326 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] 10.222.0.21 "DELETE /v2.0/networks/6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e HTTP/1.1" status: 204 len: 168 time: 0.5957425 Nov 08 04:19:11.273235 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee65ce3-1c0b-442a-a355-5911e0ea9791 admin admin] Pushing event deleted for resources: {'Network': ['ID=6e2ceb3f-7ee9-4bae-9165-286f2d6ff20e,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:11.277768 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 0789f50b-915f-4c46-85b3-aa1902eb4af4 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:19:11.278119 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0789f50b-915f-4c46-85b3-aa1902eb4af4 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:19:11.278550 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:19:11.298025 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:19:11.298365 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device d1188efc-8b55-42aa-a864-2dbeb0fbe0a3 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:19:11.298798 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 495ffdd1-ff2f-4300-b636-fa1fcc35977b no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:19:11.318764 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 495ffdd1-ff2f-4300-b636-fa1fcc35977b {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:19:11.319104 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 495ffdd1-ff2f-4300-b636-fa1fcc35977b not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:19:11.660070 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58444) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:11.698894 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-09215d11-b5af-4f30-9aba-c2daf7b9ed01 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=0efb8c7b359746668b199d14191e3f09&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0376263 Nov 08 04:19:11.701179 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58446) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:11.750569 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-67f9436f-a0bb-4ffe-8ca2-88a5102fa68b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.771859 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-67f9436f-a0bb-4ffe-8ca2-88a5102fa68b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.882782 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-67f9436f-a0bb-4ffe-8ca2-88a5102fa68b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.885740 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-67f9436f-a0bb-4ffe-8ca2-88a5102fa68b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:11.886896 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-67f9436f-a0bb-4ffe-8ca2-88a5102fa68b admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/1a7a9d09-4e67-4c3c-b165-219721505500 HTTP/1.1" status: 204 len: 168 time: 0.1848304 Nov 08 04:19:11.894309 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f9436f-a0bb-4ffe-8ca2-88a5102fa68b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a7a9d09-4e67-4c3c-b165-219721505500,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:12.683199 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cbb44e8a-82b1-48a9-b438-6c85a05c38cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:13.623504 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58516) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:13.723961 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bb620e3c-446b-4744-ad7a-c407560ad158 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:13.793786 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bb620e3c-446b-4744-ad7a-c407560ad158 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:13.842624 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-bb620e3c-446b-4744-ad7a-c407560ad158 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:13.887731 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-bb620e3c-446b-4744-ad7a-c407560ad158 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=e2c93f2d2bdd4c829e6008a61522d5a0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2631125 Nov 08 04:19:13.888946 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb620e3c-446b-4744-ad7a-c407560ad158 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df52a458-6710-4f15-92bb-0dcddc7c3c40,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:13.890756 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58520) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:13.944950 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-db2c5759-0ef9-4859-b591-9611ad1a8da9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:13.967397 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-db2c5759-0ef9-4859-b591-9611ad1a8da9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:14.066197 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-db2c5759-0ef9-4859-b591-9611ad1a8da9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:14.068945 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-db2c5759-0ef9-4859-b591-9611ad1a8da9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:14.070105 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-db2c5759-0ef9-4859-b591-9611ad1a8da9 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/df52a458-6710-4f15-92bb-0dcddc7c3c40 HTTP/1.1" status: 204 len: 168 time: 0.1783605 Nov 08 04:19:14.080964 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db2c5759-0ef9-4859-b591-9611ad1a8da9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df52a458-6710-4f15-92bb-0dcddc7c3c40,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:15.145932 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bfd31676-6f10-4c35-9794-3b9e9b8a95dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:15.970269 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:17.643063 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:18.385608 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:18.685741 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58688) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:18.787059 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9986a3ea-769c-43b3-b836-c3dadf64829c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:18.858038 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9986a3ea-769c-43b3-b836-c3dadf64829c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:18.911650 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-9986a3ea-769c-43b3-b836-c3dadf64829c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:18.952865 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-9986a3ea-769c-43b3-b836-c3dadf64829c admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=6c1bb13588bd4cbf8b95250430d64838&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2660193 Nov 08 04:19:18.953736 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9986a3ea-769c-43b3-b836-c3dadf64829c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f08f6989-2af8-4533-82a3-98f9538440cb,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:18.955813 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58696) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:19.008140 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0d14aeba-953b-42f8-8e46-50ef799679a2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:19.031172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0d14aeba-953b-42f8-8e46-50ef799679a2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:19.123047 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0d14aeba-953b-42f8-8e46-50ef799679a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:19.125698 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0d14aeba-953b-42f8-8e46-50ef799679a2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:19.126874 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-0d14aeba-953b-42f8-8e46-50ef799679a2 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/f08f6989-2af8-4533-82a3-98f9538440cb HTTP/1.1" status: 204 len: 168 time: 0.1700559 Nov 08 04:19:19.134412 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d14aeba-953b-42f8-8e46-50ef799679a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f08f6989-2af8-4533-82a3-98f9538440cb,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:19.649349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58704) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:19.662677 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-31ab4ec0-568f-4487-9bc9-7b622dcec556 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:19.733738 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-31ab4ec0-568f-4487-9bc9-7b622dcec556 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:19.802787 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-31ab4ec0-568f-4487-9bc9-7b622dcec556 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:19.840279 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-31ab4ec0-568f-4487-9bc9-7b622dcec556 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=c6985a9928254741a7734d507cb4d8a1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1897895 Nov 08 04:19:19.842104 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ab4ec0-568f-4487-9bc9-7b622dcec556 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c4ddaa6-323e-4e85-a504-3a0cdbfc3c2e,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:19.842904 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58706) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:19.891938 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-76f3445e-f6ad-419e-9712-1cdb5bdab1ea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:19.912253 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-76f3445e-f6ad-419e-9712-1cdb5bdab1ea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:20.020320 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-76f3445e-f6ad-419e-9712-1cdb5bdab1ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:20.022932 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-76f3445e-f6ad-419e-9712-1cdb5bdab1ea admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:20.024108 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-76f3445e-f6ad-419e-9712-1cdb5bdab1ea admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/4c4ddaa6-323e-4e85-a504-3a0cdbfc3c2e HTTP/1.1" status: 204 len: 168 time: 0.1801515 Nov 08 04:19:20.032528 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76f3445e-f6ad-419e-9712-1cdb5bdab1ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c4ddaa6-323e-4e85-a504-3a0cdbfc3c2e,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:22.967727 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:19:24.265818 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:31.272472 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58858) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:31.375907 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c54ec5c4-601e-4b54-a6fe-37a45c6098c4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:31.446598 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c54ec5c4-601e-4b54-a6fe-37a45c6098c4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:31.511242 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c54ec5c4-601e-4b54-a6fe-37a45c6098c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:31.549276 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-c54ec5c4-601e-4b54-a6fe-37a45c6098c4 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=b8e033a33e87444f903e35a70f6b7804&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2756884 Nov 08 04:19:31.550447 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c54ec5c4-601e-4b54-a6fe-37a45c6098c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4848f2fa-f177-489d-8b31-d4e8e930bfc8,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:31.551906 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58862) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:31.603541 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6b187cea-823e-4c2b-973d-f19706a52c7b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:31.624371 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6b187cea-823e-4c2b-973d-f19706a52c7b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:31.733980 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6b187cea-823e-4c2b-973d-f19706a52c7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:31.736574 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6b187cea-823e-4c2b-973d-f19706a52c7b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:31.737718 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-6b187cea-823e-4c2b-973d-f19706a52c7b admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/4848f2fa-f177-489d-8b31-d4e8e930bfc8 HTTP/1.1" status: 204 len: 168 time: 0.1840799 Nov 08 04:19:31.745648 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b187cea-823e-4c2b-973d-f19706a52c7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4848f2fa-f177-489d-8b31-d4e8e930bfc8,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:32.243645 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58886) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:32.256979 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-409fe05f-a22f-4290-be71-37264b520e97 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:32.330427 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-409fe05f-a22f-4290-be71-37264b520e97 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:32.368427 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-409fe05f-a22f-4290-be71-37264b520e97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:32.407111 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-409fe05f-a22f-4290-be71-37264b520e97 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=c9fc629ff04540e189bff825b667b4f3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1624093 Nov 08 04:19:32.408957 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-409fe05f-a22f-4290-be71-37264b520e97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa31c6bb-36cf-4aca-813d-b6fa5f1311b9,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:32.409822 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58890) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:32.456389 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c2d5b989-3fe9-406c-80f6-88ac6e342542 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:32.476840 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c2d5b989-3fe9-406c-80f6-88ac6e342542 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:32.597378 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c2d5b989-3fe9-406c-80f6-88ac6e342542 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:32.599981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c2d5b989-3fe9-406c-80f6-88ac6e342542 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:32.601242 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-c2d5b989-3fe9-406c-80f6-88ac6e342542 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/fa31c6bb-36cf-4aca-813d-b6fa5f1311b9 HTTP/1.1" status: 204 len: 168 time: 0.1904685 Nov 08 04:19:32.609419 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d5b989-3fe9-406c-80f6-88ac6e342542 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa31c6bb-36cf-4aca-813d-b6fa5f1311b9,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:35.392080 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58978) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:35.490854 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4333bbfd-b007-438e-aacd-206acf90e702 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:35.564423 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4333bbfd-b007-438e-aacd-206acf90e702 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:35.620045 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4333bbfd-b007-438e-aacd-206acf90e702 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:35.656866 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4333bbfd-b007-438e-aacd-206acf90e702 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42c17bc8-01cb-41ee-bc5a-5e386b3de494,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:35.661096 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-4333bbfd-b007-438e-aacd-206acf90e702 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=a5907823bad44a2f98b3419deba67c4d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2680273 Nov 08 04:19:35.663715 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58982) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:35.709932 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-21e4b602-bc55-4903-bfb6-2748c252d5be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:35.730001 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-21e4b602-bc55-4903-bfb6-2748c252d5be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:35.847958 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-21e4b602-bc55-4903-bfb6-2748c252d5be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:35.850502 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-21e4b602-bc55-4903-bfb6-2748c252d5be admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:35.851645 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-21e4b602-bc55-4903-bfb6-2748c252d5be admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/42c17bc8-01cb-41ee-bc5a-5e386b3de494 HTTP/1.1" status: 204 len: 168 time: 0.1870494 Nov 08 04:19:35.860058 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21e4b602-bc55-4903-bfb6-2748c252d5be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42c17bc8-01cb-41ee-bc5a-5e386b3de494,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:36.350926 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 58992) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:36.364879 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4eca2b51-8afa-41be-8a92-7e20034a2860 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:36.437236 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4eca2b51-8afa-41be-8a92-7e20034a2860 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:36.471136 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4eca2b51-8afa-41be-8a92-7e20034a2860 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:36.510614 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-4eca2b51-8afa-41be-8a92-7e20034a2860 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=1f2ffa42bdd545b69e3ffd3a5b4c958a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1585913 Nov 08 04:19:36.513133 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eca2b51-8afa-41be-8a92-7e20034a2860 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d00f69f4-c183-4b7b-aac2-bfc5e8491bd7,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:36.514046 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 58994) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:36.826207 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0063aedb-0939-479b-92ff-e0ed8ac8bb1e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:36.847047 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0063aedb-0939-479b-92ff-e0ed8ac8bb1e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:36.974058 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0063aedb-0939-479b-92ff-e0ed8ac8bb1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:36.976561 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0063aedb-0939-479b-92ff-e0ed8ac8bb1e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:36.977701 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-0063aedb-0939-479b-92ff-e0ed8ac8bb1e admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/d00f69f4-c183-4b7b-aac2-bfc5e8491bd7 HTTP/1.1" status: 204 len: 168 time: 0.4624982 Nov 08 04:19:36.985504 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0063aedb-0939-479b-92ff-e0ed8ac8bb1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d00f69f4-c183-4b7b-aac2-bfc5e8491bd7,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:38.531546 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59040) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:38.633891 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d630714d-dbfc-4c81-b13a-78d3aac3295d admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:38.709081 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d630714d-dbfc-4c81-b13a-78d3aac3295d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:38.779369 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d630714d-dbfc-4c81-b13a-78d3aac3295d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:38.816754 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-d630714d-dbfc-4c81-b13a-78d3aac3295d admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=a862874644a343868ae48f498fb2a523&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2839675 Nov 08 04:19:38.817595 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d630714d-dbfc-4c81-b13a-78d3aac3295d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdf03f7d-6ed9-4b29-bfea-5f55b789e24f,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:38.819499 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59044) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:38.867250 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6227a54a-d653-434a-8c4c-59ffb3676278 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:38.887573 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6227a54a-d653-434a-8c4c-59ffb3676278 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:38.991011 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6227a54a-d653-434a-8c4c-59ffb3676278 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:38.993657 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6227a54a-d653-434a-8c4c-59ffb3676278 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:38.994819 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-6227a54a-d653-434a-8c4c-59ffb3676278 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/fdf03f7d-6ed9-4b29-bfea-5f55b789e24f HTTP/1.1" status: 204 len: 168 time: 0.1742313 Nov 08 04:19:39.003362 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6227a54a-d653-434a-8c4c-59ffb3676278 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdf03f7d-6ed9-4b29-bfea-5f55b789e24f,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:40.355070 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59082) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:40.455751 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6678b75d-43fe-4cde-8219-a0ee73a86cca admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:40.528678 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6678b75d-43fe-4cde-8219-a0ee73a86cca admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:40.573570 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-6678b75d-43fe-4cde-8219-a0ee73a86cca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:40.611944 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-6678b75d-43fe-4cde-8219-a0ee73a86cca admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=26d19c41915f44d5aa31f94e4e6b2db5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2551777 Nov 08 04:19:40.614672 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59086) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:40.615178 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6678b75d-43fe-4cde-8219-a0ee73a86cca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6cac196-8e01-493e-a1b6-e62755d1ee9a,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:40.662078 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2b300898-c23a-48ca-8ffe-7c58cc400dfd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:40.682953 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2b300898-c23a-48ca-8ffe-7c58cc400dfd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:40.807918 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2b300898-c23a-48ca-8ffe-7c58cc400dfd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:40.810598 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2b300898-c23a-48ca-8ffe-7c58cc400dfd admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:40.811750 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-2b300898-c23a-48ca-8ffe-7c58cc400dfd admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/c6cac196-8e01-493e-a1b6-e62755d1ee9a HTTP/1.1" status: 204 len: 168 time: 0.1960926 Nov 08 04:19:40.819139 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b300898-c23a-48ca-8ffe-7c58cc400dfd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6cac196-8e01-493e-a1b6-e62755d1ee9a,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:42.218148 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59120) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:42.322126 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:42.392947 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:42.447912 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:42.483810 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7c84111-ff3c-4c67-8f77-e2f610fee796,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:42.487705 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=0555151c99db4737adefb7fbc3e16a22&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2684081 Nov 08 04:19:42.490255 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59134) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:42.493711 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.494056 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.494392 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.494753 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.495084 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.495414 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.495765 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.496097 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.496459 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.496779 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.497097 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.498083 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90d34796-aebe-45e3-b6cf-fc6786e056cf admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:19:42.543655 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2e67ee93-0231-46c2-9ff3-7b0ce72bfabc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:42.566695 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2e67ee93-0231-46c2-9ff3-7b0ce72bfabc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:42.688473 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b516a01d-7b7d-47ad-b687-4911876a535f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:42.694705 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2e67ee93-0231-46c2-9ff3-7b0ce72bfabc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:42.697365 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2e67ee93-0231-46c2-9ff3-7b0ce72bfabc admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:42.701937 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-2e67ee93-0231-46c2-9ff3-7b0ce72bfabc admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/d7c84111-ff3c-4c67-8f77-e2f610fee796 HTTP/1.1" status: 204 len: 168 time: 0.2072101 Nov 08 04:19:42.706330 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e67ee93-0231-46c2-9ff3-7b0ce72bfabc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7c84111-ff3c-4c67-8f77-e2f610fee796,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:45.122610 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d05b163d-de5d-4fc7-838d-c7c163414666 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:45.945053 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59194) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:45.968915 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:46.048485 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f4f75250-760d-4cf3-842a-8b23e36bffb0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:46.119085 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f4f75250-760d-4cf3-842a-8b23e36bffb0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:46.168265 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f4f75250-760d-4cf3-842a-8b23e36bffb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:46.205906 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f4f75250-760d-4cf3-842a-8b23e36bffb0 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=505be35f4d4d4d0bab46cab873bfce62&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2598140 Nov 08 04:19:46.206785 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4f75250-760d-4cf3-842a-8b23e36bffb0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af60adbc-82a7-4798-ab99-eda5bae7d628,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:46.209239 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59198) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:46.255719 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4989a875-ab93-4aa2-8d02-7352357b68e7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:46.276407 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4989a875-ab93-4aa2-8d02-7352357b68e7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:46.384927 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4989a875-ab93-4aa2-8d02-7352357b68e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:46.387425 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4989a875-ab93-4aa2-8d02-7352357b68e7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:46.388523 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-4989a875-ab93-4aa2-8d02-7352357b68e7 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/af60adbc-82a7-4798-ab99-eda5bae7d628 HTTP/1.1" status: 204 len: 168 time: 0.1780610 Nov 08 04:19:46.396523 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4989a875-ab93-4aa2-8d02-7352357b68e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af60adbc-82a7-4798-ab99-eda5bae7d628,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:46.836349 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59204) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:46.849555 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-47701391-7ae8-4c39-bed3-1ba12e71941b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:46.925376 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-47701391-7ae8-4c39-bed3-1ba12e71941b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:46.962637 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-47701391-7ae8-4c39-bed3-1ba12e71941b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:47.000840 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-47701391-7ae8-4c39-bed3-1ba12e71941b admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=acb88330dd004c8194d9531c4aead29e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1634321 Nov 08 04:19:47.001940 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47701391-7ae8-4c39-bed3-1ba12e71941b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d415de1d-0b73-44bd-af3e-f385c0de1d65,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:47.003668 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59206) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:19:47.064857 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-30acf5b5-cb85-4d86-8d34-214c3c65d066 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:47.089948 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-30acf5b5-cb85-4d86-8d34-214c3c65d066 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:47.185311 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-30acf5b5-cb85-4d86-8d34-214c3c65d066 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:47.187918 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-30acf5b5-cb85-4d86-8d34-214c3c65d066 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:47.189691 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-30acf5b5-cb85-4d86-8d34-214c3c65d066 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/d415de1d-0b73-44bd-af3e-f385c0de1d65 HTTP/1.1" status: 204 len: 168 time: 0.1849811 Nov 08 04:19:47.197993 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30acf5b5-cb85-4d86-8d34-214c3c65d066 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d415de1d-0b73-44bd-af3e-f385c0de1d65,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:19:47.596942 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:48.357127 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:54.299738 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:19:59.191535 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32d1e0ba-21cd-4797-8e77-a1812f738a82 req-a746b475-08d9-4865-b82c-27008dcde6ee tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:19:59.193015 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32d1e0ba-21cd-4797-8e77-a1812f738a82 req-a746b475-08d9-4865-b82c-27008dcde6ee tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0485520 Nov 08 04:19:59.253539 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32d1e0ba-21cd-4797-8e77-a1812f738a82 req-4831a37f-d1e1-4b41-bff5-3e7c35b8c5a4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468040 Nov 08 04:19:59.966440 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:20:00.369924 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b2c498-b569-4d95-b616-340718c311dd req-8e851427-df5b-4629-9ad6-f6d9cab1a646 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:00.371379 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-17b2c498-b569-4d95-b616-340718c311dd req-8e851427-df5b-4629-9ad6-f6d9cab1a646 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0479405 Nov 08 04:20:00.419052 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-17b2c498-b569-4d95-b616-340718c311dd req-b291cb23-f063-4d43-b673-2b9b3e95aeea tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418417 Nov 08 04:20:01.534286 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2046e3b0-d3d3-482b-9db3-fcbd3926bd5e req-453bc824-4caa-4564-81c5-6f1dc1901864 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:01.535727 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2046e3b0-d3d3-482b-9db3-fcbd3926bd5e req-453bc824-4caa-4564-81c5-6f1dc1901864 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0514607 Nov 08 04:20:01.582350 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2046e3b0-d3d3-482b-9db3-fcbd3926bd5e req-db328317-bc50-4904-bfe5-5f5bbd0e57dd tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407135 Nov 08 04:20:02.697760 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e64cec1-9461-4b65-9a96-3b6b34d35fa8 req-ddbfdb53-473a-4bb1-a0a7-4896bbe5db44 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:02.699226 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6e64cec1-9461-4b65-9a96-3b6b34d35fa8 req-ddbfdb53-473a-4bb1-a0a7-4896bbe5db44 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0494649 Nov 08 04:20:02.748595 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6e64cec1-9461-4b65-9a96-3b6b34d35fa8 req-ec5f0ab5-0be2-421f-a312-7ddbe98876a0 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433626 Nov 08 04:20:03.866701 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7050383b-adaa-4c91-9bf0-5c3d05ce612d req-ca802462-fcc7-4e30-9ef8-1210b11a3eb1 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:03.868162 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7050383b-adaa-4c91-9bf0-5c3d05ce612d req-ca802462-fcc7-4e30-9ef8-1210b11a3eb1 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0521226 Nov 08 04:20:03.916029 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7050383b-adaa-4c91-9bf0-5c3d05ce612d req-c469017a-452d-46cd-9e95-834657d2ccc3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421324 Nov 08 04:20:05.029702 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-179443a0-3baa-4677-8cb1-1b92ab350c57 req-ddafe4b8-d0c7-49d8-b62b-9fa9429dd4d4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:05.031193 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-179443a0-3baa-4677-8cb1-1b92ab350c57 req-ddafe4b8-d0c7-49d8-b62b-9fa9429dd4d4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0478971 Nov 08 04:20:05.080488 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-179443a0-3baa-4677-8cb1-1b92ab350c57 req-137a6985-cb22-48f9-8cca-3c1d68395ab6 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422835 Nov 08 04:20:05.967243 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59430) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:06.068756 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:06.150774 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:06.208246 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57918d9c-8258-49de-b9ac-3adbfeb33c05 req-1e9a6d8e-28d3-496c-9e4a-1d758b6c7c45 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:06.211189 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-57918d9c-8258-49de-b9ac-3adbfeb33c05 req-1e9a6d8e-28d3-496c-9e4a-1d758b6c7c45 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0534792 Nov 08 04:20:06.229757 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:06.287123 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=a73175de50f140d4b5ca38c8e93d3a91&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3187869 Nov 08 04:20:06.290001 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59436) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:06.291729 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d93421b6-6ab8-4b92-9a26-03f80d2c1087,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:06.298982 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-57918d9c-8258-49de-b9ac-3adbfeb33c05 req-9faca97c-a023-45b3-bea1-a69652e0ebb0 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0827031 Nov 08 04:20:06.303730 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.304083 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.304426 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.304765 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.305099 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.305429 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.305816 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.306915 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.306915 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.306915 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.307176 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.307358 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f812ca9-2a64-414e-9c79-152cf89d1df6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:06.339956 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e941ef72-fa20-4620-93a8-b0980f7b8158 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:06.360904 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e941ef72-fa20-4620-93a8-b0980f7b8158 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:06.470836 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e941ef72-fa20-4620-93a8-b0980f7b8158 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:06.474068 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e941ef72-fa20-4620-93a8-b0980f7b8158 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:06.475259 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e941ef72-fa20-4620-93a8-b0980f7b8158 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/d93421b6-6ab8-4b92-9a26-03f80d2c1087 HTTP/1.1" status: 204 len: 168 time: 0.1841817 Nov 08 04:20:06.483121 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e941ef72-fa20-4620-93a8-b0980f7b8158 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d93421b6-6ab8-4b92-9a26-03f80d2c1087,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:07.024215 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59442) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:07.038989 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0b879a87-3598-411d-b97d-110983e70bd2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:07.109494 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0b879a87-3598-411d-b97d-110983e70bd2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:07.173826 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-0b879a87-3598-411d-b97d-110983e70bd2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:07.212229 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-0b879a87-3598-411d-b97d-110983e70bd2 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=fbd53542ad51401d9da408a088059124&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1868837 Nov 08 04:20:07.213346 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b879a87-3598-411d-b97d-110983e70bd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bb3e81e-391b-485b-b267-9b0e71b4cabd,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:07.214978 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59444) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:07.263181 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5bd5823f-fd9b-433d-af3b-dd871c7c1308 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:07.284716 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5bd5823f-fd9b-433d-af3b-dd871c7c1308 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:07.398454 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5bd5823f-fd9b-433d-af3b-dd871c7c1308 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:07.400959 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5bd5823f-fd9b-433d-af3b-dd871c7c1308 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:07.402045 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-5bd5823f-fd9b-433d-af3b-dd871c7c1308 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/7bb3e81e-391b-485b-b267-9b0e71b4cabd HTTP/1.1" status: 204 len: 168 time: 0.1860251 Nov 08 04:20:07.413848 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bd5823f-fd9b-433d-af3b-dd871c7c1308 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bb3e81e-391b-485b-b267-9b0e71b4cabd,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:07.430623 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937c6a1a-7d7b-41d7-a707-83f0bd7c6735 req-68c54c9d-9adf-4836-9fa9-174ee7dad251 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:07.432155 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-937c6a1a-7d7b-41d7-a707-83f0bd7c6735 req-68c54c9d-9adf-4836-9fa9-174ee7dad251 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0644591 Nov 08 04:20:07.483778 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-937c6a1a-7d7b-41d7-a707-83f0bd7c6735 req-c28f7f62-d471-4539-820e-e30b6db2d5f2 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439000 Nov 08 04:20:08.599441 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b361a27-d859-4c96-bd62-19e7d64546fa req-1aa6d83a-9d67-461d-b711-4d217e4298c7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:08.600895 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6b361a27-d859-4c96-bd62-19e7d64546fa req-1aa6d83a-9d67-461d-b711-4d217e4298c7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0484800 Nov 08 04:20:08.650054 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6b361a27-d859-4c96-bd62-19e7d64546fa req-734b68a3-e8fa-4289-b8d4-7c1c8892825b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429866 Nov 08 04:20:09.421664 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-3a82ecdc-bd47-4f7e-937a-e8c8b874adc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:09.423184 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-3a82ecdc-bd47-4f7e-937a-e8c8b874adc2 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=9e6436a3d5084995840a192763eea4ae&device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 1098 time: 0.0393732 Nov 08 04:20:09.515274 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-686ee4f5-1543-4312-b347-9e841fc532e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:09.516709 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-686ee4f5-1543-4312-b347-9e841fc532e0 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6fbc518a-d762-4340-b3c4-10e04086e375 HTTP/1.1" status: 200 len: 910 time: 0.0862553 Nov 08 04:20:09.581452 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-48a2d539-e12b-453e-bfc6-2a1c164ca0f7 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a HTTP/1.1" status: 200 len: 1001 time: 0.0570800 Nov 08 04:20:09.639051 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-e9f60eb1-05c2-4df4-ac20-5434081e43ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:09.640502 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-e9f60eb1-05c2-4df4-ac20-5434081e43ff service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cde96b9f-aad6-4299-909d-9e2c0a335515 HTTP/1.1" status: 200 len: 848 time: 0.0526953 Nov 08 04:20:09.687215 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-761beb6d-d17f-4692-a203-a9caaca680aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:09.687779 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-761beb6d-d17f-4692-a203-a9caaca680aa service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6fbc518a-d762-4340-b3c4-10e04086e375&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404277 Nov 08 04:20:09.810499 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5525bf70-d40a-441f-b011-d3ef99bebe27 req-331b26b4-c5bc-49a7-ac63-4e50ac3d783e tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:09.811944 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5525bf70-d40a-441f-b011-d3ef99bebe27 req-331b26b4-c5bc-49a7-ac63-4e50ac3d783e tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0944734 Nov 08 04:20:09.815516 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-25546f74-0f86-4861-bddc-9e9bfdefb378 service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1204734 Nov 08 04:20:09.919620 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5525bf70-d40a-441f-b011-d3ef99bebe27 req-35de645e-7fa4-425a-875a-a9cc16255d37 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1016624 Nov 08 04:20:09.942466 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c98c99d2-5679-45cc-a5ec-539ae1bec563 req-410b5c5b-a8cc-4507-a111-1c561e0ccadc service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1187088 Nov 08 04:20:11.033388 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e5270c-2f2d-4858-8332-bb55ed7e235d req-fd5549aa-12f5-4f78-9a08-ca32993ad2f5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:11.034924 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-11e5270c-2f2d-4858-8332-bb55ed7e235d req-fd5549aa-12f5-4f78-9a08-ca32993ad2f5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0486760 Nov 08 04:20:11.083910 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-11e5270c-2f2d-4858-8332-bb55ed7e235d req-317b3289-f0a6-44d9-b75a-9e24de959f9f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430305 Nov 08 04:20:12.201300 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b825c4a-710c-4a66-b4ee-9e0ea3b7c2c2 req-ec5fb09f-f02c-4bdf-9261-16767db05ef8 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:12.202887 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b825c4a-710c-4a66-b4ee-9e0ea3b7c2c2 req-ec5fb09f-f02c-4bdf-9261-16767db05ef8 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0514760 Nov 08 04:20:12.253815 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b825c4a-710c-4a66-b4ee-9e0ea3b7c2c2 req-3d70c8b9-cfd4-4661-ac45-d69ff792ee38 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449462 Nov 08 04:20:12.653563 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e9d7ad68-a6b0-49c0-aef8-f37f31e4d468 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:13.374688 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42f1d855-4c6c-4f8e-9c69-241cd37ce748 req-286a77fc-b9a7-4362-946a-f04af292ebcb tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:13.376280 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-42f1d855-4c6c-4f8e-9c69-241cd37ce748 req-286a77fc-b9a7-4362-946a-f04af292ebcb tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0525455 Nov 08 04:20:13.425733 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-42f1d855-4c6c-4f8e-9c69-241cd37ce748 req-a7642d17-43fb-4b21-9f86-7b01d578cda1 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428329 Nov 08 04:20:14.537794 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ea9bb77-2018-4292-9527-21d59fdf08e7 req-90b4d2f8-40a4-4701-b5aa-84fb5a834948 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:14.539308 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8ea9bb77-2018-4292-9527-21d59fdf08e7 req-90b4d2f8-40a4-4701-b5aa-84fb5a834948 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0480731 Nov 08 04:20:14.592456 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8ea9bb77-2018-4292-9527-21d59fdf08e7 req-9f7a7384-1fbd-462f-8013-9c30282fac24 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470564 Nov 08 04:20:14.887545 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd0ff57d-7a2e-426d-a4f4-d520bd09df91 req-88adc8ee-fef0-42c0-ad53-c5e70a01b156 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:14.889014 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fd0ff57d-7a2e-426d-a4f4-d520bd09df91 req-88adc8ee-fef0-42c0-ad53-c5e70a01b156 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0590823 Nov 08 04:20:14.942807 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fd0ff57d-7a2e-426d-a4f4-d520bd09df91 req-0c175549-70c7-4e30-89fa-13378947f3b1 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467732 Nov 08 04:20:14.991736 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [req-fef2465d-6898-4a84-b947-51e4d1470361 req-427cc091-361e-405b-ba6e-9663aa5df225 service neutron] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1380336 Nov 08 04:20:15.122887 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-ae6d0cb7-3477-455b-bf15-5035d8209322 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:15.973664 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:16.058249 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afa6cf0b-e393-44be-80fc-b740ec9c8154 req-154f2908-6b3d-48bd-8fbc-64e8c92fd27c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:16.059736 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-afa6cf0b-e393-44be-80fc-b740ec9c8154 req-154f2908-6b3d-48bd-8fbc-64e8c92fd27c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0487568 Nov 08 04:20:16.108787 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-afa6cf0b-e393-44be-80fc-b740ec9c8154 req-f0e2f1c2-3be3-4f62-9cb7-31a1d9c4b10f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429661 Nov 08 04:20:17.002834 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:20:17.074073 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:17.095426 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:20:17.098248 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7c81faa-07f5-47b9-bb64-522d2a99c3af" -d '{"events": [{"server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "name": "network-vif-unplugged", "status": "completed", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:20:17.110657 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:20:17.135812 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 08 Nov 2021 04:20:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7641b1c2-d606-4b8a-b369-076dca71d071 x-openstack-request-id: req-7641b1c2-d606-4b8a-b369-076dca71d071 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:20:17.136097 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "name": "network-vif-unplugged", "status": "completed", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:20:17.136651 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-7641b1c2-d606-4b8a-b369-076dca71d071 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:20:17.136760 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'code': 200} Nov 08 04:20:17.167764 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:17.218616 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,revision_number=6']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:17.222279 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f844986a-8799-4809-ba4f-cf60a543e872 req-e77de282-3b48-4f19-94f0-f9ff2a8317aa tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:17.224106 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f844986a-8799-4809-ba4f-cf60a543e872 req-e77de282-3b48-4f19-94f0-f9ff2a8317aa tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0487595 Nov 08 04:20:17.225716 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.226072 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.226412 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.226770 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.227118 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.227533 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.227733 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.228060 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.228386 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.228707 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.229027 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.229345 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:17.275384 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f844986a-8799-4809-ba4f-cf60a543e872 req-d775f8c4-51c8-4dfc-abed-edae18544a2b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413270 Nov 08 04:20:17.630757 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:18.351010 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:18.394956 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a980b5-5a99-46b7-9fc8-2093f9f779ff req-d0bf4ec8-54c7-4402-9bb3-8bcd31fc1658 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:18.396451 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e6a980b5-5a99-46b7-9fc8-2093f9f779ff req-d0bf4ec8-54c7-4402-9bb3-8bcd31fc1658 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0528941 Nov 08 04:20:18.447785 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e6a980b5-5a99-46b7-9fc8-2093f9f779ff req-5206ab81-945d-4f69-87a9-ecff73d83833 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441406 Nov 08 04:20:19.559671 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8fecf3f-7424-462a-aedf-35336e8e1c2e req-709eb000-8205-405c-aadb-260585cc3531 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:19.561153 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e8fecf3f-7424-462a-aedf-35336e8e1c2e req-709eb000-8205-405c-aadb-260585cc3531 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0477214 Nov 08 04:20:19.612140 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e8fecf3f-7424-462a-aedf-35336e8e1c2e req-10e8fcc3-f817-4aac-8368-2c8c0e217841 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442309 Nov 08 04:20:20.727662 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d4ca4bb-b27b-447b-b02b-5da1475317ec req-99badd1e-355f-4d90-be9a-acdfe5d4e24f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:20.729114 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d4ca4bb-b27b-447b-b02b-5da1475317ec req-99badd1e-355f-4d90-be9a-acdfe5d4e24f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0515909 Nov 08 04:20:20.777289 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d4ca4bb-b27b-447b-b02b-5da1475317ec req-8ea7808e-5c41-4a4f-974f-9c24e83e8441 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420356 Nov 08 04:20:21.922737 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73fffcad-7667-43df-91b9-e98f5e5f55cf req-b9b0c820-85c0-492e-93b2-e12a39785605 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:21.924270 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-73fffcad-7667-43df-91b9-e98f5e5f55cf req-b9b0c820-85c0-492e-93b2-e12a39785605 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0805845 Nov 08 04:20:21.928386 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-818bec49-787d-497a-b685-40a687a808d5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1718587729&fields=id&tenant_id=aa58a6fe20a449858977c517ca68518b HTTP/1.1" status: 200 len: 267 time: 0.0740211 Nov 08 04:20:22.039945 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-73fffcad-7667-43df-91b9-e98f5e5f55cf req-65de1eab-1bcc-496e-aa62-91ea4167c66f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1095607 Nov 08 04:20:22.072656 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-3b3c3824-e281-4591-b5d0-c0023d1cc939 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:22.074090 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-3b3c3824-e281-4591-b5d0-c0023d1cc939 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 812 time: 0.1370246 Nov 08 04:20:22.089161 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-5a5c0bab-5e49-4add-8be8-b403621bba8c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/quotas/aa58a6fe20a449858977c517ca68518b HTTP/1.1" status: 200 len: 375 time: 0.0090063 Nov 08 04:20:22.147988 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-fd4bb12a-3c3c-4368-8166-af3946a4d48c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0535679 Nov 08 04:20:22.247100 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-53786d6a-e072-4e46-99f1-c267c1c8bf36 service neutron] 10.222.0.21 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869956 Nov 08 04:20:22.362051 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-dc05944f-114c-4be5-8ff2-2be79ac0b8d7 service neutron] 10.222.0.21 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1076136 Nov 08 04:20:22.371234 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef2465d-6898-4a84-b947-51e4d1470361 req-bab8cc7d-d622-4da5-b690-1d59a43a82da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:22.372611 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fef2465d-6898-4a84-b947-51e4d1470361 req-bab8cc7d-d622-4da5-b690-1d59a43a82da service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec&tenant_id=9e6436a3d5084995840a192763eea4ae HTTP/1.1" status: 200 len: 1096 time: 0.0565515 Nov 08 04:20:22.444670 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef2465d-6898-4a84-b947-51e4d1470361 req-56afee0b-0b4c-408d-b2af-08680de94aff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:22.446203 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fef2465d-6898-4a84-b947-51e4d1470361 req-56afee0b-0b4c-408d-b2af-08680de94aff service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=9e6436a3d5084995840a192763eea4ae&device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 1096 time: 0.0421054 Nov 08 04:20:22.540238 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef2465d-6898-4a84-b947-51e4d1470361 req-e68eabaf-c552-4b31-a7bc-f5a4f8e9ddc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:22.541675 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fef2465d-6898-4a84-b947-51e4d1470361 req-e68eabaf-c552-4b31-a7bc-f5a4f8e9ddc6 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6fbc518a-d762-4340-b3c4-10e04086e375 HTTP/1.1" status: 200 len: 910 time: 0.0874226 Nov 08 04:20:22.612206 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fef2465d-6898-4a84-b947-51e4d1470361 req-2c9c742e-51b8-4d95-b85d-299e5215c4bb service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a HTTP/1.1" status: 200 len: 999 time: 0.0627639 Nov 08 04:20:22.661546 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef2465d-6898-4a84-b947-51e4d1470361 req-c3da7aac-1967-43d6-b6a3-92196bef92d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:22.662929 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fef2465d-6898-4a84-b947-51e4d1470361 req-c3da7aac-1967-43d6-b6a3-92196bef92d5 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cde96b9f-aad6-4299-909d-9e2c0a335515 HTTP/1.1" status: 200 len: 848 time: 0.0444260 Nov 08 04:20:22.708799 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef2465d-6898-4a84-b947-51e4d1470361 req-ee7da2a8-ec6c-4a81-9d93-9dfff2d00a07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:22.710251 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fef2465d-6898-4a84-b947-51e4d1470361 req-ee7da2a8-ec6c-4a81-9d93-9dfff2d00a07 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6fbc518a-d762-4340-b3c4-10e04086e375&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0394950 Nov 08 04:20:22.810445 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fef2465d-6898-4a84-b947-51e4d1470361 req-7ae5f115-afd9-457d-a00c-46346e0fcddb service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927382 Nov 08 04:20:22.904308 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fef2465d-6898-4a84-b947-51e4d1470361 req-d0347f23-be19-40f6-a1ee-e649c11da395 service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0862825 Nov 08 04:20:22.952374 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ef108175-7e3e-4aec-9387-89e3d0d1e936 req-bcdde679-12f8-4229-88ff-6e295a94af95 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0294383 Nov 08 04:20:23.154655 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-006dd4e3-8f1c-4d74-af97-8b9eb11f459a req-370f757a-f1ee-4c00-817c-cd52a994190f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:23.156225 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-006dd4e3-8f1c-4d74-af97-8b9eb11f459a req-370f757a-f1ee-4c00-817c-cd52a994190f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0490344 Nov 08 04:20:23.206336 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-006dd4e3-8f1c-4d74-af97-8b9eb11f459a req-345ac6c0-d837-4931-92ae-e664cc1206e5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436058 Nov 08 04:20:24.049910 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1ffed5d9-126d-4174-86dd-e8ad96c38b39 req-f00d24da-e596-4b9c-9bd4-65c30d5b77fe tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0255487 Nov 08 04:20:24.282263 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:24.323363 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d60db3-3b84-4212-ba5c-3e25735ce8d8 req-990d9ad5-ae5d-493e-81b1-d8c2cf8a261f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:24.324799 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00d60db3-3b84-4212-ba5c-3e25735ce8d8 req-990d9ad5-ae5d-493e-81b1-d8c2cf8a261f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0475659 Nov 08 04:20:24.376509 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00d60db3-3b84-4212-ba5c-3e25735ce8d8 req-5a59e9d7-d6c9-4a84-a4be-8840dfb3068f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451427 Nov 08 04:20:24.558542 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59698) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:24.681405 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9118ebb6-8083-4125-a7f9-96164267b05e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:24.712015 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-f3a5b734-14a9-48f6-a8b1-c3f8f10f4dc2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:24.713479 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-f3a5b734-14a9-48f6-a8b1-c3f8f10f4dc2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 812 time: 0.1251056 Nov 08 04:20:24.806205 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-31dd8edc-2bc4-4709-9a7f-f870ed14f110 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aa58a6fe20a449858977c517ca68518b HTTP/1.1" status: 200 len: 380 time: 0.0774980 Nov 08 04:20:24.820957 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'port': {'device_id': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'admin_state_up': True, 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'security_groups': ['b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb']}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:20:24.842684 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9118ebb6-8083-4125-a7f9-96164267b05e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:24.900458 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-9118ebb6-8083-4125-a7f9-96164267b05e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:24.956545 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9118ebb6-8083-4125-a7f9-96164267b05e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd28edb4-6953-4381-97bd-e016ef07d478,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:24.965331 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-9118ebb6-8083-4125-a7f9-96164267b05e admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=a4d4865a04204e0db0747d446f7e3e64&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4056830 Nov 08 04:20:24.968025 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59702) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:25.025090 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c8fca99d-1ba8-4c43-90ee-55ec17361998 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:25.045368 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c8fca99d-1ba8-4c43-90ee-55ec17361998 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:25.077343 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Made reservation on behalf of aa58a6fe20a449858977c517ca68518b for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:20:25.080699 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:25.145052 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-96f735b3-6825-4962-b0bd-f6a0fef64e31 req-197a6ee2-4a93-42ca-8ee4-efd0ce9b510c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258708 Nov 08 04:20:25.176020 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c8fca99d-1ba8-4c43-90ee-55ec17361998 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:25.178568 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c8fca99d-1ba8-4c43-90ee-55ec17361998 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:25.179652 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-c8fca99d-1ba8-4c43-90ee-55ec17361998 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/cd28edb4-6953-4381-97bd-e016ef07d478 HTTP/1.1" status: 204 len: 168 time: 0.2107739 Nov 08 04:20:25.217458 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8fca99d-1ba8-4c43-90ee-55ec17361998 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd28edb4-6953-4381-97bd-e016ef07d478,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:25.289015 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Allocated IP 172.20.0.5 (16cbde97-55ea-47f6-bd55-cf46e7c41a49/5926063e-8f31-4623-9cfc-4a0b577bdb41/0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:20:25.427345 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:25.505728 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c459fa2-e083-484c-b95a-16af279e0ed3 req-d4b271e4-efdd-4213-922f-0f78071019c1 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:25.507780 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8c459fa2-e083-484c-b95a-16af279e0ed3 req-d4b271e4-efdd-4213-922f-0f78071019c1 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0601053 Nov 08 04:20:25.558532 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8c459fa2-e083-484c-b95a-16af279e0ed3 req-54b7f025-e68b-4ac2-b63e-a2ab1577739d tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446906 Nov 08 04:20:25.562625 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:25.603852 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:20:25.609100 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:20:25.613471 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:20:25.636656 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'Port': ['ID=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:25.665565 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:25.666178 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:25.776550 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-25e8eb1f-20f8-495f-a2d6-3cf878132ee4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9591708 Nov 08 04:20:25.788153 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-bec096ad-14ba-4126-b2f4-b633b64433c7 None None] Provisioning complete for port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 triggered by entity DHCP. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:20:25.788652 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bec096ad-14ba-4126-b2f4-b633b64433c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:25.801242 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Request body: {'port': {'device_id': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:20:25.825231 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-bec096ad-14ba-4126-b2f4-b633b64433c7 None None] Port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 cannot update to ACTIVE because it is not bound. {{(pid=101666) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 08 04:20:25.859395 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:25.920154 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59712) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:25.933350 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-437ab74e-451d-4495-8f9a-fb61dac50609 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.006348 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-437ab74e-451d-4495-8f9a-fb61dac50609 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.087891 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-437ab74e-451d-4495-8f9a-fb61dac50609 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.113657 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-437ab74e-451d-4495-8f9a-fb61dac50609 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=f7039e907b7343e49c79e2aa4ce86c1c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1923442 Nov 08 04:20:26.114362 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:20:26.118438 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59714) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:26.128586 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.132629 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-437ab74e-451d-4495-8f9a-fb61dac50609 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=192e1782-d8c6-4e10-8755-ac7b5d592c10,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:26.157931 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Transition to ACTIVE for port object 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:20:26.185480 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f6861808-2d87-4804-84e1-97c1ed897fba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.209077 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f6861808-2d87-4804-84e1-97c1ed897fba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.241681 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.334780 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Pushing event updated for resources: {'Port': ['ID=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:26.361151 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-394291a0-5c8a-43fc-9a87-d31bd86d60d3 req-8311f96f-1a72-4364-9adc-a5591426937a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:26.371621 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-394291a0-5c8a-43fc-9a87-d31bd86d60d3 req-8311f96f-1a72-4364-9adc-a5591426937a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.1433101 Nov 08 04:20:26.424910 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f6861808-2d87-4804-84e1-97c1ed897fba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.427547 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f6861808-2d87-4804-84e1-97c1ed897fba admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.428685 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f6861808-2d87-4804-84e1-97c1ed897fba admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/192e1782-d8c6-4e10-8755-ac7b5d592c10 HTTP/1.1" status: 204 len: 168 time: 0.3092911 Nov 08 04:20:26.456490 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6861808-2d87-4804-84e1-97c1ed897fba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=192e1782-d8c6-4e10-8755-ac7b5d592c10,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:26.463945 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-394291a0-5c8a-43fc-9a87-d31bd86d60d3 req-670645b6-a44e-4bff-acfd-c069e1e7fb86 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0788577 Nov 08 04:20:26.466921 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Attempting to bind port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:20:26.467253 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Attempting to bind port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:20:26.467584 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Attempting to bind port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:20:26.472421 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:20:26.472745 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Attempting to bind port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 on network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:20:26.484983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 20, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:20:26.484983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Checking segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:20:26.484983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Bound using segment: {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:20:26.484983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Bound port: 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '45e39c1d-17e6-4d15-9e5d-2931daeb0af1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 186, 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:20:26.484983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.542748 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] For port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:20:26.545895 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] For port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:20:26.625716 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.686311 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:26.686959 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:26.688319 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] 10.222.0.16 "PUT /v2.0/ports/0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 HTTP/1.1" status: 200 len: 1093 time: 0.8921800 Nov 08 04:20:26.691145 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:20:26.693220 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02f69080-9ab2-42b4-935b-db9830807445" -d '{"events": [{"name": "network-changed", "server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:20:26.720864 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e460a53a-6ddf-4465-8484-284e813645c1 service neutron] Pushing event updated for resources: {'Port': ['ID=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:26.738062 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea852896-76f7-4412-82e1-e6b615503157 req-fbf91d44-b8c5-4a76-a0a7-10fac4933a59 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:26.739717 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea852896-76f7-4412-82e1-e6b615503157 req-fbf91d44-b8c5-4a76-a0a7-10fac4933a59 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.1078305 Nov 08 04:20:26.743268 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:20:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ffed566-cf86-4892-bcc3-eaf3d6090f1f x-openstack-request-id: req-1ffed566-cf86-4892-bcc3-eaf3d6090f1f {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:20:26.743557 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:20:26.743810 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-1ffed566-cf86-4892-bcc3-eaf3d6090f1f {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:20:26.744204 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'status': 'completed', 'code': 200} Nov 08 04:20:26.830434 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea852896-76f7-4412-82e1-e6b615503157 req-56458a82-1c42-4eb2-b6a2-1f7a4be2fc56 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0839508 Nov 08 04:20:26.851547 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f69080-9ab2-42b4-935b-db9830807445 req-f6b0d7d9-4a81-44f4-ae42-49e3d500e994 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:26.851547 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02f69080-9ab2-42b4-935b-db9830807445 req-f6b0d7d9-4a81-44f4-ae42-49e3d500e994 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 1096 time: 0.0564613 Nov 08 04:20:26.957064 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f69080-9ab2-42b4-935b-db9830807445 req-f1855372-5ea7-4213-a2b3-a6625e362507 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:26.959075 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02f69080-9ab2-42b4-935b-db9830807445 req-f1855372-5ea7-4213-a2b3-a6625e362507 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=aa58a6fe20a449858977c517ca68518b&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0959775 Nov 08 04:20:27.053735 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f69080-9ab2-42b4-935b-db9830807445 req-acbf5953-a28c-4877-a489-af048fccc9ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:27.055219 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02f69080-9ab2-42b4-935b-db9830807445 req-acbf5953-a28c-4877-a489-af048fccc9ee service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0887542 Nov 08 04:20:27.153816 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-6d092c12-500c-4898-9c00-ea40d3c0bb76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:27.155281 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-6d092c12-500c-4898-9c00-ea40d3c0bb76 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 1096 time: 0.0423410 Nov 08 04:20:27.203330 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-b6c1ab4b-dca6-46c9-9dec-a8fc940d7794 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 HTTP/1.1" status: 200 len: 217 time: 0.0334535 Nov 08 04:20:27.251574 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-65857ccd-806b-4ce5-81cb-b9e0a7978a20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:27.253101 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-65857ccd-806b-4ce5-81cb-b9e0a7978a20 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0443206 Nov 08 04:20:27.299275 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-005e27fb-210e-47b5-bf4b-c427e01c1fd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:27.300743 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-005e27fb-210e-47b5-bf4b-c427e01c1fd6 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402145 Nov 08 04:20:27.393917 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-415e4077-a635-4b5f-87a1-e0823595648b service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858996 Nov 08 04:20:27.485598 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99cda78d-1d69-48cd-a5ed-57491761d5b5 req-a9cc530e-ed0f-4074-b05c-6b9a8874c7b3 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838320 Nov 08 04:20:27.583276 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780b90c3-eeb1-4048-b231-3760b9663cd3 req-237c7892-81a1-4caf-bbc5-8f21c7952384 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:27.584821 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-780b90c3-eeb1-4048-b231-3760b9663cd3 req-237c7892-81a1-4caf-bbc5-8f21c7952384 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0498598 Nov 08 04:20:27.634794 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-780b90c3-eeb1-4048-b231-3760b9663cd3 req-c1c87de5-1c6e-4364-9ab7-67bb52ae1f12 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437412 Nov 08 04:20:27.739481 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-bce3766f-3ff1-4752-9d88-582a5294b28c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:27.740960 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-bce3766f-3ff1-4752-9d88-582a5294b28c service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=9e6436a3d5084995840a192763eea4ae&device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 1096 time: 0.0410326 Nov 08 04:20:27.845512 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-589fe164-1a80-4dce-b9a0-b39e71adb948 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:27.846993 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-589fe164-1a80-4dce-b9a0-b39e71adb948 service neutron] 10.222.0.16 "GET /v2.0/networks?id=6fbc518a-d762-4340-b3c4-10e04086e375 HTTP/1.1" status: 200 len: 910 time: 0.0859325 Nov 08 04:20:27.924610 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-beaeeb63-f77a-46b2-bfa0-f2b91afd2067 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a HTTP/1.1" status: 200 len: 999 time: 0.0690594 Nov 08 04:20:28.272918 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb213323-fd92-402b-8597-ff9b8772a240 req-d648a549-504f-4bf0-8069-c28413ac9ba0 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:28.274298 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb213323-fd92-402b-8597-ff9b8772a240 req-d648a549-504f-4bf0-8069-c28413ac9ba0 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.3640792 Nov 08 04:20:28.275705 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-ea462480-d4d3-46a8-8d6d-9c88a5d4322e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:28.276909 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-ea462480-d4d3-46a8-8d6d-9c88a5d4322e service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cde96b9f-aad6-4299-909d-9e2c0a335515 HTTP/1.1" status: 200 len: 848 time: 0.3353465 Nov 08 04:20:28.350130 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-e5a41f33-ab9a-4a5d-9bc4-12fc033d8937 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:28.351705 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-e5a41f33-ab9a-4a5d-9bc4-12fc033d8937 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6fbc518a-d762-4340-b3c4-10e04086e375&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0651958 Nov 08 04:20:28.356252 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb213323-fd92-402b-8597-ff9b8772a240 req-68759c5e-01ec-4913-af86-7effca306fb7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754116 Nov 08 04:20:28.450135 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-74c7bc74-1fcf-463f-8e26-88fac0636207 service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893734 Nov 08 04:20:28.542301 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5cf67720-f948-4dc0-91ce-ec07e5cb1185 req-7f26ad4d-fde5-47ce-9432-82d45e59e4bc service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0803144 Nov 08 04:20:28.755084 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e182be-373d-4a19-8fb7-5b6ad5cc5c8c req-fd6dce5a-5ca5-4761-a1ec-ab4f097b89c8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:28.756619 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62e182be-373d-4a19-8fb7-5b6ad5cc5c8c req-fd6dce5a-5ca5-4761-a1ec-ab4f097b89c8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0526693 Nov 08 04:20:28.807639 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62e182be-373d-4a19-8fb7-5b6ad5cc5c8c req-119aa6b9-607a-43b8-946b-ad4683a66e55 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427723 Nov 08 04:20:28.840291 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59780) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:28.949028 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b3f4851d-a841-4cf1-a9d8-88d2397f0854 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:29.020556 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b3f4851d-a841-4cf1-a9d8-88d2397f0854 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:29.104778 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b3f4851d-a841-4cf1-a9d8-88d2397f0854 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:29.143811 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-b3f4851d-a841-4cf1-a9d8-88d2397f0854 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=b4d9b6a74f07410da95b7d920dd1c9ca&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3024404 Nov 08 04:20:29.144665 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f4851d-a841-4cf1-a9d8-88d2397f0854 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0b243a5-4661-4ec8-b9dd-7b121bbe7fca,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:29.146465 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59784) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:29.192719 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb7c1bd5-ce64-406a-8ae1-36554fb2d8be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:29.215119 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb7c1bd5-ce64-406a-8ae1-36554fb2d8be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:29.321901 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb7c1bd5-ce64-406a-8ae1-36554fb2d8be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:29.324582 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb7c1bd5-ce64-406a-8ae1-36554fb2d8be admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:29.325725 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-cb7c1bd5-ce64-406a-8ae1-36554fb2d8be admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/e0b243a5-4661-4ec8-b9dd-7b121bbe7fca HTTP/1.1" status: 204 len: 168 time: 0.1782212 Nov 08 04:20:29.333764 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb7c1bd5-ce64-406a-8ae1-36554fb2d8be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0b243a5-4661-4ec8-b9dd-7b121bbe7fca,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:29.477877 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1eeab6c-e95a-4ffb-b743-d36ea2e576fa req-04a07a64-d35c-434c-a52e-91ac998d06d3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:29.479383 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e1eeab6c-e95a-4ffb-b743-d36ea2e576fa req-04a07a64-d35c-434c-a52e-91ac998d06d3 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 943 time: 0.0516882 Nov 08 04:20:29.527928 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e1eeab6c-e95a-4ffb-b743-d36ea2e576fa req-c5910d3d-8f93-476c-ab7a-a815ba4df22f tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423808 Nov 08 04:20:29.929805 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c99e3d-f3f6-43cf-b7af-7468791520f7 req-47a1b512-9084-415b-b5fc-52f0334350a7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:29.931347 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92c99e3d-f3f6-43cf-b7af-7468791520f7 req-47a1b512-9084-415b-b5fc-52f0334350a7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0578706 Nov 08 04:20:29.933097 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59794) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:29.951203 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bbcf237b-ab2f-4cd7-98f9-cb5938fe0881 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:29.975214 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:20:30.005428 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92c99e3d-f3f6-43cf-b7af-7468791520f7 req-caf5c113-f3c2-4b24-a993-ad4b103dc346 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0662060 Nov 08 04:20:30.055387 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bbcf237b-ab2f-4cd7-98f9-cb5938fe0881 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:30.070170 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:20:30.081147 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'port_id': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'mac_address': 'fa:16:3e:be:a3:b5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:20:30.110764 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bbcf237b-ab2f-4cd7-98f9-cb5938fe0881 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:30.117752 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:30.130515 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:20:30.149168 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:20:30.151938 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-bbcf237b-ab2f-4cd7-98f9-cb5938fe0881 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=d57f4794c9a6452285e4dbeb56154ce2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2179780 Nov 08 04:20:30.152784 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbcf237b-ab2f-4cd7-98f9-cb5938fe0881 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f228063-5a95-4cbc-956b-199ff245f61f,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:30.154631 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59796) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:30.202284 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:30.205600 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7b872376-c9fc-4752-810b-75f998231ba8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:30.229684 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7b872376-c9fc-4752-810b-75f998231ba8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:30.262076 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,revision_number=7']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:30.361914 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7b872376-c9fc-4752-810b-75f998231ba8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:30.364541 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7b872376-c9fc-4752-810b-75f998231ba8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:30.365691 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-7b872376-c9fc-4752-810b-75f998231ba8 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/9f228063-5a95-4cbc-956b-199ff245f61f HTTP/1.1" status: 204 len: 168 time: 0.2100611 Nov 08 04:20:30.373307 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b872376-c9fc-4752-810b-75f998231ba8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f228063-5a95-4cbc-956b-199ff245f61f,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:30.508204 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:20:30.646043 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5aa798-6342-426c-ace9-dd9cb646e439 req-81f1c86b-7b5c-41e1-aa65-adb7947e575c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:30.647592 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0a5aa798-6342-426c-ace9-dd9cb646e439 req-81f1c86b-7b5c-41e1-aa65-adb7947e575c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 944 time: 0.0503678 Nov 08 04:20:30.700827 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0a5aa798-6342-426c-ace9-dd9cb646e439 req-05222268-2b1f-4cae-8b27-4f72d9891908 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448897 Nov 08 04:20:31.118672 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68d30bbc-ca5a-4d51-b804-e4becf074f89 req-66c24491-18ad-4c81-885a-e855eacc02d9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:31.120139 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-68d30bbc-ca5a-4d51-b804-e4becf074f89 req-66c24491-18ad-4c81-885a-e855eacc02d9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0477047 Nov 08 04:20:31.167441 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-68d30bbc-ca5a-4d51-b804-e4becf074f89 req-4ef683a5-06d9-405b-8937-a628468482e8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415258 Nov 08 04:20:31.819961 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91ac10d7-bb99-4ac2-9d6a-d6e7eedc522c req-86ac9bb0-7aa4-4432-8a7c-cac9908e1509 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:31.821438 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91ac10d7-bb99-4ac2-9d6a-d6e7eedc522c req-86ac9bb0-7aa4-4432-8a7c-cac9908e1509 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 944 time: 0.0518363 Nov 08 04:20:31.822141 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59832) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:31.878463 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91ac10d7-bb99-4ac2-9d6a-d6e7eedc522c req-0fcb1c4a-e1ea-4e46-b207-ed8084282f9d tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505068 Nov 08 04:20:31.927341 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4700575e-9d4d-416a-8651-7970f78fde4e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:31.977374 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:20:31.999511 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4700575e-9d4d-416a-8651-7970f78fde4e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:32.026992 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:20:32.028197 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:32.081914 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-4700575e-9d4d-416a-8651-7970f78fde4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:32.099729 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:32.120525 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-4700575e-9d4d-416a-8651-7970f78fde4e admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=f8ff37efa88d43ac8641adb7e853e79c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2972085 Nov 08 04:20:32.121397 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4700575e-9d4d-416a-8651-7970f78fde4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb50cf6a-438f-4b6c-b4c3-86ecc7c6c33e,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:32.122554 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:20:32.123342 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59836) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:32.125505 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e06ae839-3f6f-409b-a433-ddf38ca884c5" -d '{"events": [{"server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "name": "network-vif-plugged", "status": "completed", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:20:32.139457 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:20:32.166187 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:20:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6cbc5e8-2b13-4237-9842-531f1845804f x-openstack-request-id: req-e6cbc5e8-2b13-4237-9842-531f1845804f {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:20:32.166187 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "name": "network-vif-plugged", "status": "completed", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:20:32.166187 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-e6cbc5e8-2b13-4237-9842-531f1845804f {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:20:32.166187 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'code': 200} Nov 08 04:20:32.183044 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a47a7296-eb02-4f41-9cea-f6a863bc7fd1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:32.208495 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:32.212076 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a47a7296-eb02-4f41-9cea-f6a863bc7fd1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:32.262594 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,revision_number=8']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:32.289977 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7806c320-9962-499e-a300-b33d1c258b39 req-08c386fa-ff76-4004-aaa2-29e66c8d43f8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:32.291480 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7806c320-9962-499e-a300-b33d1c258b39 req-08c386fa-ff76-4004-aaa2-29e66c8d43f8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0515659 Nov 08 04:20:32.327806 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a47a7296-eb02-4f41-9cea-f6a863bc7fd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:32.330565 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a47a7296-eb02-4f41-9cea-f6a863bc7fd1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:32.331785 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a47a7296-eb02-4f41-9cea-f6a863bc7fd1 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/fb50cf6a-438f-4b6c-b4c3-86ecc7c6c33e HTTP/1.1" status: 204 len: 168 time: 0.2074351 Nov 08 04:20:32.340830 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a47a7296-eb02-4f41-9cea-f6a863bc7fd1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb50cf6a-438f-4b6c-b4c3-86ecc7c6c33e,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:32.352275 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7806c320-9962-499e-a300-b33d1c258b39 req-6cac164b-517a-411a-94f0-5e1b8fa08b4e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0547938 Nov 08 04:20:32.532242 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c989bb-edb5-400a-8741-82fb997fcc55 req-28681a4a-358e-4f1d-9de7-fc25be7b2f25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:32.533787 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-46c989bb-edb5-400a-8741-82fb997fcc55 req-28681a4a-358e-4f1d-9de7-fc25be7b2f25 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 1098 time: 0.0399244 Nov 08 04:20:32.584982 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-46c989bb-edb5-400a-8741-82fb997fcc55 req-4ddbfc21-a09c-4ed6-aca9-bdd1e15cada0 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387352 Nov 08 04:20:32.994521 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55e4e498-a7a1-4325-9d43-953b59921637 req-79a40d6c-ffbe-4868-b487-4f40f120286d tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:32.995313 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55e4e498-a7a1-4325-9d43-953b59921637 req-79a40d6c-ffbe-4868-b487-4f40f120286d tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0485277 Nov 08 04:20:33.044492 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55e4e498-a7a1-4325-9d43-953b59921637 req-25c4b44b-d0b7-48d5-aea1-67deded4b121 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431311 Nov 08 04:20:33.475805 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-175f7b58-ade0-4dc2-a196-6f055fbdd5c4 req-8022f243-f196-4d3e-98ab-8df06ab264fe tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:33.483689 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-175f7b58-ade0-4dc2-a196-6f055fbdd5c4 req-8022f243-f196-4d3e-98ab-8df06ab264fe tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0523415 Nov 08 04:20:33.526725 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-175f7b58-ade0-4dc2-a196-6f055fbdd5c4 req-e2afda27-7158-455b-83bf-26bd459c58c3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431013 Nov 08 04:20:33.990312 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:20:34.085035 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:20:34.166163 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f9c4c02-3b98-4e61-a2d5-f233b5e557f5 req-916f9ae8-cd6f-47a7-be50-b0e65c3e5ced tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:34.168124 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0f9c4c02-3b98-4e61-a2d5-f233b5e557f5 req-916f9ae8-cd6f-47a7-be50-b0e65c3e5ced tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0520372 Nov 08 04:20:34.224731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0f9c4c02-3b98-4e61-a2d5-f233b5e557f5 req-996fb822-8066-43c9-bd8f-d400f93d0283 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500114 Nov 08 04:20:34.235195 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'port_id': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'mac_address': 'fa:16:3e:53:b5:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 186, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:20:34.278830 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:34.291190 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:20:34.310134 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:20:34.413658 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:34.463353 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:34.649008 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20a1d4e5-76c7-48b1-b691-d21e7223ba72 req-29bbd624-7a95-4a40-b301-8d1477045d03 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:34.650464 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-20a1d4e5-76c7-48b1-b691-d21e7223ba72 req-29bbd624-7a95-4a40-b301-8d1477045d03 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 944 time: 0.0526710 Nov 08 04:20:34.699509 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-20a1d4e5-76c7-48b1-b691-d21e7223ba72 req-fbecdede-1ad1-4b23-a10f-9160f6ce50d6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432279 Nov 08 04:20:34.701917 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:20:35.813162 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd5c3ae-15fe-4e35-926e-d76f48bc5e91 req-084f0b06-7a70-46e7-85a3-2bb84eb9e6da tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:35.814626 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1bd5c3ae-15fe-4e35-926e-d76f48bc5e91 req-084f0b06-7a70-46e7-85a3-2bb84eb9e6da tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 944 time: 0.0480847 Nov 08 04:20:35.863230 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1bd5c3ae-15fe-4e35-926e-d76f48bc5e91 req-0cc59d6c-6b8a-41ae-a82b-ae755aaef880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425246 Nov 08 04:20:36.005884 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:20:36.116146 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:20:36.119748 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:20:36.120111 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:36.192824 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:36.217088 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:20:36.219473 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10fb405c-c396-429d-8d6f-a710e96b82d4" -d '{"events": [{"server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "name": "network-vif-plugged", "status": "completed", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:20:36.242732 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:20:36.264197 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:20:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a2c8655a-c5b6-498b-9282-e5f32c7b0d67 x-openstack-request-id: req-a2c8655a-c5b6-498b-9282-e5f32c7b0d67 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:20:36.264488 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "name": "network-vif-plugged", "status": "completed", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:20:36.264735 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-a2c8655a-c5b6-498b-9282-e5f32c7b0d67 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:20:36.265124 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'code': 200} Nov 08 04:20:36.310553 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:36.360082 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:36.631186 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f6782d-caf3-446e-945d-30bcabfdf61d req-87a7274d-6a63-46a0-8ed8-57fced1412e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:36.632652 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-12f6782d-caf3-446e-945d-30bcabfdf61d req-87a7274d-6a63-46a0-8ed8-57fced1412e7 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 1098 time: 0.0417218 Nov 08 04:20:36.684346 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-12f6782d-caf3-446e-945d-30bcabfdf61d req-cb03c4c8-923c-48b6-a8ec-02ad3cffe8b5 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442889 Nov 08 04:20:36.964603 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:20:36.977923 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619bf21d-325e-400e-979c-173fdb55702a req-88587cf7-99c8-47d2-a7b4-70620ba06026 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:36.979436 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-619bf21d-325e-400e-979c-173fdb55702a req-88587cf7-99c8-47d2-a7b4-70620ba06026 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 945 time: 0.0509739 Nov 08 04:20:37.028259 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-619bf21d-325e-400e-979c-173fdb55702a req-046d3a4e-727b-4523-ba0e-a1684fd534bb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425079 Nov 08 04:20:38.149064 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75834a63-5392-4be7-a5d4-8027e8db6ed4 req-5ba3727d-f26c-4a6c-a32f-98e3409246ca tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:38.150648 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-75834a63-5392-4be7-a5d4-8027e8db6ed4 req-5ba3727d-f26c-4a6c-a32f-98e3409246ca tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 945 time: 0.0523605 Nov 08 04:20:38.198099 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-75834a63-5392-4be7-a5d4-8027e8db6ed4 req-5ac9ab0a-b93c-4090-9c03-086612298442 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417037 Nov 08 04:20:38.320057 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69773c6c-173e-4190-9e0f-0bafba14358a req-b13022f8-b097-4ac0-9776-b0448cd0f9e4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:38.322534 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-69773c6c-173e-4190-9e0f-0bafba14358a req-b13022f8-b097-4ac0-9776-b0448cd0f9e4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 945 time: 0.0555036 Nov 08 04:20:38.371271 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-69773c6c-173e-4190-9e0f-0bafba14358a req-c5d4125d-76fb-4538-8588-38a30d3c44f3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427709 Nov 08 04:20:38.394727 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59944) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:38.432524 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94edf1a7-d59d-48c3-9849-74412b7c6fa9 tempest-TestVolumeBootPattern-2005605993 tempest-TestVolumeBootPattern-2005605993-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:38.434003 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-94edf1a7-d59d-48c3-9849-74412b7c6fa9 tempest-TestVolumeBootPattern-2005605993 tempest-TestVolumeBootPattern-2005605993-project-admin] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 1093 time: 0.0382776 Nov 08 04:20:38.436954 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59946) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:38.441726 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Request body: {'floatingip': {'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'port_id': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address': '172.20.0.5'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:20:38.527769 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:38.627596 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:38.726639 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Allocated IP 172.27.2.240 (5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4/d4daf4b1-2c47-4c16-a8ea-4d93b75219c9/60176f8f-dab7-4beb-bb55-92943947e592) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:20:38.826364 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:38.899541 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:38.936778 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Network 5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4 is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:20:38.943069 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:20:38.947360 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:20:38.950235 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'Port': ['ID=60176f8f-dab7-4beb-bb55-92943947e592,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:39.291991 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:39.426732 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:39.572070 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:39.728029 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:39.801638 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event updated for resources: {'Port': ['ID=60176f8f-dab7-4beb-bb55-92943947e592,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:39.810348 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-688789'] for floatingip, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:39.910425 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Floating IP 20fefe9a-4bb5-45ce-b163-6b2fe4da3eaf associated. External IP: 172.27.2.240, port: 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0. Nov 08 04:20:40.115456 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Router 8aa2c265-b728-4ac3-97de-f276d80d2037 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:20:40.219393 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:20:40.229367 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] Sync routers for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:20:40.245712 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:20:40.246318 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:20:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:20:40.324478 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:40.352011 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-802aa46c-a1ba-452a-82b9-09a90ef5e988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9140387 Nov 08 04:20:40.352597 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:20:40.354894 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0" -d '{"events": [{"name": "network-changed", "server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:20:40.364276 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:20:40.392390 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:20:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f247c648-9672-4704-bdf4-3e4a07f33429 x-openstack-request-id: req-f247c648-9672-4704-bdf4-3e4a07f33429 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:20:40.392682 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:20:40.392932 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-f247c648-9672-4704-bdf4-3e4a07f33429 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:20:40.393371 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'status': 'completed', 'code': 200} Nov 08 04:20:40.478752 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-64e5e2ff-7322-4a83-a109-a029bccf6b4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:40.480250 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-64e5e2ff-7322-4a83-a109-a029bccf6b4b service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 1098 time: 0.0435734 Nov 08 04:20:40.568524 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-614431b4-8239-4117-b9a1-c47a4c29ed3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:40.569978 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-614431b4-8239-4117-b9a1-c47a4c29ed3c service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0828922 Nov 08 04:20:40.589664 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '00ce2f97-4322-45b8-8cd1-e53e8e1e43b6', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:24:43:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:18:28Z', 'updated_at': '2021-11-08T04:18:30Z', 'revision_number': 1, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}, {'id': '20fefe9a-4bb5-45ce-b163-6b2fe4da3eaf', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.240', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:53:b5:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:20:39Z', 'updated_at': '2021-11-08T04:20:39Z', 'revision_number': 0, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:20:40.620388 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] Checking router: 8aa2c265-b728-4ac3-97de-f276d80d2037 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:20:40.628624 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:20:40.629229 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:20:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:20:40.641702 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-b3df36b7-a13d-4cc4-9fca-674255aef0e4 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 HTTP/1.1" status: 200 len: 999 time: 0.0643287 Nov 08 04:20:40.690508 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-a2eab454-6886-4bbf-bbd1-8faa8d4e6cf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:40.691953 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-a2eab454-6886-4bbf-bbd1-8faa8d4e6cf9 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0425491 Nov 08 04:20:40.733012 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:20:40.736615 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-bf2396e6-ca21-4817-bc03-460186135046 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:40.738130 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-bf2396e6-ca21-4817-bc03-460186135046 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0391042 Nov 08 04:20:40.833796 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-80683228-f881-4eda-befb-59f5fb7a247b service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874901 Nov 08 04:20:40.924388 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c2ac028-8ce4-41c3-985a-cbf764c90ff0 req-f6da9af5-2027-4f71-b235-2e13603560cc service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827003 Nov 08 04:20:40.957013 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '00ce2f97-4322-45b8-8cd1-e53e8e1e43b6', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:24:43:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:18:28Z', 'updated_at': '2021-11-08T04:18:30Z', 'revision_number': 1, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}, {'id': '20fefe9a-4bb5-45ce-b163-6b2fe4da3eaf', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.240', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:53:b5:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:20:39Z', 'updated_at': '2021-11-08T04:20:39Z', 'revision_number': 0, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:20:40.986689 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71ea1f73-496b-4edb-a3ae-bd5178f849af None None] The sync data for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi is: [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '00ce2f97-4322-45b8-8cd1-e53e8e1e43b6', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:24:43:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:18:28Z', 'updated_at': '2021-11-08T04:18:30Z', 'revision_number': 1, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}, {'id': '20fefe9a-4bb5-45ce-b163-6b2fe4da3eaf', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.240', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:53:b5:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:20:39Z', 'updated_at': '2021-11-08T04:20:39Z', 'revision_number': 0, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:20:41.188027 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e937fcb-0ecb-4c64-bbc1-1fb2ad08294c None None] New status for floating IP 20fefe9a-4bb5-45ce-b163-6b2fe4da3eaf: ACTIVE {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:20:42.647538 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-80adc93a-5303-4b2d-ba6d-285ca462bb5e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:42.906635 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 59992) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:43.009158 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:43.079669 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:43.127405 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:43.165162 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=dcc9750a36d14d069c95707d261e61e8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2574823 Nov 08 04:20:43.166225 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3a78538-2270-4248-8cdf-a1c6284d637b,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:43.167910 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 59996) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:43.173460 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.173807 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.174144 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.174474 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.174834 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.175158 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.175505 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.175860 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.176179 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.176496 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.176829 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.177145 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90f5bdc-8c25-4695-a1b6-53bea7e6dc63 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:20:43.218184 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-606f5f5f-75c9-4979-8e9b-e7a65f48884b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:43.239104 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-606f5f5f-75c9-4979-8e9b-e7a65f48884b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:43.350382 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-606f5f5f-75c9-4979-8e9b-e7a65f48884b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:43.352906 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-606f5f5f-75c9-4979-8e9b-e7a65f48884b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:43.354040 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-606f5f5f-75c9-4979-8e9b-e7a65f48884b admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/d3a78538-2270-4248-8cdf-a1c6284d637b HTTP/1.1" status: 204 len: 168 time: 0.1851747 Nov 08 04:20:43.369996 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-606f5f5f-75c9-4979-8e9b-e7a65f48884b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3a78538-2270-4248-8cdf-a1c6284d637b,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:43.897666 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60002) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:43.910506 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-64f2e3e8-4056-4973-8349-4cb4b2b71bff admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:43.983145 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-64f2e3e8-4056-4973-8349-4cb4b2b71bff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:44.047859 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-64f2e3e8-4056-4973-8349-4cb4b2b71bff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:44.087891 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f2e3e8-4056-4973-8349-4cb4b2b71bff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40211349-c010-43ac-a58c-bef669def9f1,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:44.092574 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-64f2e3e8-4056-4973-8349-4cb4b2b71bff admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=8c4c4ec8f24243b181d44afd0906cca1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1938882 Nov 08 04:20:44.095218 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60004) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:44.142189 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b0fb9680-e4b1-49d1-a0e1-cd494079661f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:44.162880 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b0fb9680-e4b1-49d1-a0e1-cd494079661f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:44.264785 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b0fb9680-e4b1-49d1-a0e1-cd494079661f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:44.267440 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-b0fb9680-e4b1-49d1-a0e1-cd494079661f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:44.273382 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-b0fb9680-e4b1-49d1-a0e1-cd494079661f admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/40211349-c010-43ac-a58c-bef669def9f1 HTTP/1.1" status: 204 len: 168 time: 0.1744306 Nov 08 04:20:44.286855 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0fb9680-e4b1-49d1-a0e1-cd494079661f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40211349-c010-43ac-a58c-bef669def9f1,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:44.915362 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 60010) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:44.928547 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-45675162-c5e4-4fcb-a75c-903f9d709912 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:45.003375 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-45675162-c5e4-4fcb-a75c-903f9d709912 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:45.053122 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-45675162-c5e4-4fcb-a75c-903f9d709912 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:45.094066 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-45675162-c5e4-4fcb-a75c-903f9d709912 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=dd4b111e62e546019ea511aa1f5bf6cf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1776149 Nov 08 04:20:45.095036 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45675162-c5e4-4fcb-a75c-903f9d709912 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08c334d2-0669-48e2-b17a-3834de1bee41,revision_number=1']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:45.096761 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60012) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:45.128416 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-6227504d-739d-464d-9a99-be38a6cfd6a4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:45.145288 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb235be2-d449-42db-95d9-84c8bf259f98 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:45.165567 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb235be2-d449-42db-95d9-84c8bf259f98 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:45.276504 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb235be2-d449-42db-95d9-84c8bf259f98 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:45.279469 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-cb235be2-d449-42db-95d9-84c8bf259f98 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:45.280623 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-cb235be2-d449-42db-95d9-84c8bf259f98 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/08c334d2-0669-48e2-b17a-3834de1bee41 HTTP/1.1" status: 204 len: 168 time: 0.1828983 Nov 08 04:20:45.293444 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb235be2-d449-42db-95d9-84c8bf259f98 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08c334d2-0669-48e2-b17a-3834de1bee41,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:46.007238 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:46.289543 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60034) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:46.384183 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-272976409-network', 'tenant_id': '8e5d49c7aaba44d380042cbff995c227'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:20:46.488386 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Made reservation on behalf of 8e5d49c7aaba44d380042cbff995c227 for: {'network': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:20:46.490696 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for network, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:46.499172 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:46.569012 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:46.647616 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:46.668281 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] vlan segment allocate from pool success with {'vlan_id': 191, 'physical_network': 'physnet1'} {{(pid=101665) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 08 04:20:46.683084 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:46.687166 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:46.687499 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.segments_db [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Added segment a422b515-4eaf-4235-a3e4-a2fa0790f882 of type vlan for network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb Nov 08 04:20:46.729029 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8785435696339'] for network, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:46.830266 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161'] for network, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:46.831769 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:46.832349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:46.888983 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] Pushing event updated for resources: {'Network': ['ID=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:46.903583 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb details requested by agent ovs-agent-dv-cinder-783643-4-iscsi with host dv-cinder-783643-4-iscsi {{(pid=101666) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 08 04:20:46.924617 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-a20ed088-715c-4b75-bbb4-c9fc371227a1 admin admin] 10.222.0.21 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.6339910 Nov 08 04:20:46.927513 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60042) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:20:46.932472 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Request body: {'subnet': {'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-272976409-subnet', 'tenant_id': '8e5d49c7aaba44d380042cbff995c227', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:20:47.019644 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Made reservation on behalf of 8e5d49c7aaba44d380042cbff995c227 for: {'subnet': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:20:47.021998 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-4372208'] for subnet, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:47.247934 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-6273101', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-4372234'] for subnet, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:47.306024 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b7476cdf-e453-4db0-a095-7baf9278351d,revision_number=0']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:47.313110 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Checking segment: {'id': 'a422b515-4eaf-4235-a3e4-a2fa0790f882', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:20:47.313461 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Network hostable DHCP agents. Network: 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb, hostable agents: ['e65031f0-c9e4-46bd-ab81-2152f4ce1d02'], hosted agents: [] {{(pid=101665) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 08 04:20:47.384687 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb is scheduled to be hosted by DHCP agent e65031f0-c9e4-46bd-ab81-2152f4ce1d02 with binding_index 1 {{(pid=101665) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 08 04:20:47.470382 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-783643-4-iscsi, 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb) {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:20:47.474346 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:47.474955 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:47.479563 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-422d52fd-944a-4d48-a69a-3700cf1b5371 None None] Network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:20:47.591564 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-18984318-f8e4-42d8-83ce-4bf002fa34a0 admin admin] 10.222.0.21 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.6629169 Nov 08 04:20:47.609533 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34be34e4-51ea-4b56-9802-cb9fd414d891 None None] Network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:20:47.661225 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:48.413009 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:49.610826 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-ed73b89c-cb53-412e-a918-3a1933fc2533 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:49.612927 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-ed73b89c-cb53-412e-a918-3a1933fc2533 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/networks?id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 200 len: 813 time: 0.0986564 Nov 08 04:20:49.627155 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-8ced791d-697c-4115-b4da-a0465f51e3ef tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/quotas/8e5d49c7aaba44d380042cbff995c227 HTTP/1.1" status: 200 len: 375 time: 0.0087197 Nov 08 04:20:49.656545 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-6beae4c1-d8d0-4291-bfbe-725086052f0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0242338 Nov 08 04:20:49.746378 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-8fb53d58-2f37-4d39-8462-a09c854076d4 service neutron] 10.222.0.21 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824125 Nov 08 04:20:49.831518 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-fd1bb34f-94c8-4044-ba2c-80ff45a8939e service neutron] 10.222.0.21 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0784512 Nov 08 04:20:50.067455 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8cd57946-6f37-4888-9e66-980108794a02 req-8d55ff25-1d82-4276-9fed-fec91b55eb66 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 210 time: 0.0297971 Nov 08 04:20:51.158569 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a17bd813-7398-4cfc-b746-35db22317fd9 req-5c057aa8-dda4-42f6-b7ec-51ea5ec17898 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 210 time: 0.0266118 Nov 08 04:20:52.055174 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-8190623c-7232-49d0-aed6-000435860535 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:52.056770 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-8190623c-7232-49d0-aed6-000435860535 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.16 "GET /v2.0/networks?id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 200 len: 813 time: 0.0996606 Nov 08 04:20:52.080295 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Request body: {'port': {'device_id': '088cdd76-cef5-4177-8847-c4beb1dbb4b6', 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb', 'admin_state_up': True, 'tenant_id': '8e5d49c7aaba44d380042cbff995c227'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:20:52.224588 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Made reservation on behalf of 8e5d49c7aaba44d380042cbff995c227 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:20:52.228196 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:52.261502 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-88877bad-4726-434b-8d28-437af77f70c0 req-d36779f6-3744-484b-8f0e-fea9dec40d55 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 210 time: 0.0309348 Nov 08 04:20:52.387351 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Allocated IP 172.20.0.10 (9f4f71e5-fbed-4c5a-b59e-c195c2501dbb/b7476cdf-e453-4db0-a095-7baf9278351d/826f0333-43b9-4b01-8dc9-95a51cee8702) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:20:52.531489 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:52.887878 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:52.928989 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:20:52.933878 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:20:52.941232 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:20:52.960303 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Pushing event updated for resources: {'Port': ['ID=826f0333-43b9-4b01-8dc9-95a51cee8702,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:52.987761 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:52.988356 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:53.055562 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-5604c783-b28f-4398-bbee-2babfaff1a7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9789588 Nov 08 04:20:53.076250 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Request body: {'port': {'device_id': '088cdd76-cef5-4177-8847-c4beb1dbb4b6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:20:53.130619 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:53.412594 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba11bf58-7ab3-4a05-842f-95f65f69b2b4 req-9a008dfa-4fb1-4d30-b1d4-cbd4c5e90845 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:53.414039 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ba11bf58-7ab3-4a05-842f-95f65f69b2b4 req-9a008dfa-4fb1-4d30-b1d4-cbd4c5e90845 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 932 time: 0.0851841 Nov 08 04:20:53.428722 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 826f0333-43b9-4b01-8dc9-95a51cee8702 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:20:53.444711 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:53.469735 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Transition to ACTIVE for port object 826f0333-43b9-4b01-8dc9-95a51cee8702 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:20:53.483883 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ba11bf58-7ab3-4a05-842f-95f65f69b2b4 req-7f4c1ba8-578f-4c90-92b3-f7bcd98bd8a5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0635030 Nov 08 04:20:53.544662 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:53.595479 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Pushing event updated for resources: {'Port': ['ID=826f0333-43b9-4b01-8dc9-95a51cee8702,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:53.656699 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Attempting to bind port 826f0333-43b9-4b01-8dc9-95a51cee8702 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:20:53.657038 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Attempting to bind port 826f0333-43b9-4b01-8dc9-95a51cee8702 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': 'a422b515-4eaf-4235-a3e4-a2fa0790f882', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:20:53.657359 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Attempting to bind port 826f0333-43b9-4b01-8dc9-95a51cee8702 on network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:20:53.661607 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Port 826f0333-43b9-4b01-8dc9-95a51cee8702 on network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:20:53.661925 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Attempting to bind port 826f0333-43b9-4b01-8dc9-95a51cee8702 on network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:20:53.666669 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 20, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:20:53.667001 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Checking segment: {'id': 'a422b515-4eaf-4235-a3e4-a2fa0790f882', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:20:53.667380 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Bound using segment: {'id': 'a422b515-4eaf-4235-a3e4-a2fa0790f882', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:20:53.667798 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Bound port: 826f0333-43b9-4b01-8dc9-95a51cee8702, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a422b515-4eaf-4235-a3e4-a2fa0790f882', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:20:53.668140 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:53.730247 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] For port 826f0333-43b9-4b01-8dc9-95a51cee8702, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:20:53.733422 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] For port 826f0333-43b9-4b01-8dc9-95a51cee8702, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=826f0333-43b9-4b01-8dc9-95a51cee8702,segment=NetworkSegment(a422b515-4eaf-4235-a3e4-a2fa0790f882),segment_id=a422b515-4eaf-4235-a3e4-a2fa0790f882)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:20:53.807927 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:53.840582 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:53.841533 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:53.842932 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-7c400520-6e18-4182-909c-59867227ee1f service neutron] 10.222.0.16 "PUT /v2.0/ports/826f0333-43b9-4b01-8dc9-95a51cee8702 HTTP/1.1" status: 200 len: 1094 time: 0.7707794 Nov 08 04:20:53.844966 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '088cdd76-cef5-4177-8847-c4beb1dbb4b6', 'tag': '826f0333-43b9-4b01-8dc9-95a51cee8702'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:20:53.847769 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a58698f1-9641-42a2-b1a4-1cd6fe7103b4" -d '{"events": [{"name": "network-changed", "server_uuid": "088cdd76-cef5-4177-8847-c4beb1dbb4b6", "tag": "826f0333-43b9-4b01-8dc9-95a51cee8702"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:20:53.874095 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c400520-6e18-4182-909c-59867227ee1f service neutron] Pushing event updated for resources: {'Port': ['ID=826f0333-43b9-4b01-8dc9-95a51cee8702,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:53.889378 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:20:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e976a3fb-0a9f-46d0-9c50-29805a0488da x-openstack-request-id: req-e976a3fb-0a9f-46d0-9c50-29805a0488da {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:20:53.889505 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "088cdd76-cef5-4177-8847-c4beb1dbb4b6", "tag": "826f0333-43b9-4b01-8dc9-95a51cee8702", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:20:53.889735 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-e976a3fb-0a9f-46d0-9c50-29805a0488da {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:20:53.890157 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '088cdd76-cef5-4177-8847-c4beb1dbb4b6', 'tag': '826f0333-43b9-4b01-8dc9-95a51cee8702', 'status': 'completed', 'code': 200} Nov 08 04:20:53.976693 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a58698f1-9641-42a2-b1a4-1cd6fe7103b4 req-90c59a1d-3ed5-4e5a-afe5-7c169de525fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:53.978159 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a58698f1-9641-42a2-b1a4-1cd6fe7103b4 req-90c59a1d-3ed5-4e5a-afe5-7c169de525fd service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 1097 time: 0.0410092 Nov 08 04:20:54.085081 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a58698f1-9641-42a2-b1a4-1cd6fe7103b4 req-5eb8ed48-583c-42a7-a8b2-fc2bd2cb59dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:54.086458 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a58698f1-9641-42a2-b1a4-1cd6fe7103b4 req-5eb8ed48-583c-42a7-a8b2-fc2bd2cb59dc service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=8e5d49c7aaba44d380042cbff995c227&shared=False HTTP/1.1" status: 200 len: 914 time: 0.0914018 Nov 08 04:20:54.183609 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a58698f1-9641-42a2-b1a4-1cd6fe7103b4 req-d4e2c02b-ef77-4759-ae33-f9090609cb27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:54.185023 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a58698f1-9641-42a2-b1a4-1cd6fe7103b4 req-d4e2c02b-ef77-4759-ae33-f9090609cb27 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0848432 Nov 08 04:20:54.282180 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:54.302135 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-0c334037-a1c7-4ee7-9e94-cbd61c8f3b46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:54.303690 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-0c334037-a1c7-4ee7-9e94-cbd61c8f3b46 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 1097 time: 0.0451093 Nov 08 04:20:54.358864 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-472c8cd9-8958-429e-a173-322b8429fe28 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=826f0333-43b9-4b01-8dc9-95a51cee8702 HTTP/1.1" status: 200 len: 217 time: 0.0394087 Nov 08 04:20:54.411253 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-b3fac45e-1a16-449e-aa94-c213ce7429b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:54.412639 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-b3fac45e-1a16-449e-aa94-c213ce7429b3 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b7476cdf-e453-4db0-a095-7baf9278351d HTTP/1.1" status: 200 len: 853 time: 0.0467610 Nov 08 04:20:54.444153 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-a1748d66-211b-42e5-899d-1cc712d4e8c3 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0228460 Nov 08 04:20:54.540101 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-6245b0ab-0366-465c-a924-9e8b7b2a0653 service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868456 Nov 08 04:20:54.663717 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afe854b1-9fde-49ac-9e6c-ec330b25edb8 req-a9ea9534-3817-4575-be70-858a78928e54 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:54.665063 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-afe854b1-9fde-49ac-9e6c-ec330b25edb8 req-a9ea9534-3817-4575-be70-858a78928e54 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 944 time: 0.1085680 Nov 08 04:20:54.670577 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef86409-200a-4c79-b007-6ce2dcb5e935 req-b407d1b5-7821-44f5-a120-1ded1265130f service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1220131 Nov 08 04:20:54.712891 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-afe854b1-9fde-49ac-9e6c-ec330b25edb8 req-2e53da1e-33b5-4774-81d5-9484949d5d7c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413837 Nov 08 04:20:55.827457 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c592f66-a0d6-48f5-a24c-68e5a84b855f req-985487a3-96eb-4c89-8c88-422c58a3800d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:55.828911 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c592f66-a0d6-48f5-a24c-68e5a84b855f req-985487a3-96eb-4c89-8c88-422c58a3800d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 944 time: 0.0478482 Nov 08 04:20:55.875305 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c592f66-a0d6-48f5-a24c-68e5a84b855f req-55e4a869-1d4f-485d-bbd2-2a2edca7247e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394421 Nov 08 04:20:56.992230 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-271ca2cc-f277-492a-8432-d59826382908 req-81b519ea-05e0-465a-bdf9-12c5681e66ed tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:56.993691 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-271ca2cc-f277-492a-8432-d59826382908 req-81b519ea-05e0-465a-bdf9-12c5681e66ed tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 944 time: 0.0518742 Nov 08 04:20:57.038672 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-271ca2cc-f277-492a-8432-d59826382908 req-0e2790cc-76bb-43fd-ac54-ce10635d1697 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390675 Nov 08 04:20:58.083460 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 826f0333-43b9-4b01-8dc9-95a51cee8702 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:20:58.150549 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a0826b7-0b2c-49b3-8662-649ebd8c991d req-f636136c-4cab-4332-9e26-fcad60a57865 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:58.152031 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2a0826b7-0b2c-49b3-8662-649ebd8c991d req-f636136c-4cab-4332-9e26-fcad60a57865 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 944 time: 0.0484338 Nov 08 04:20:58.175034 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 826f0333-43b9-4b01-8dc9-95a51cee8702, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=826f0333-43b9-4b01-8dc9-95a51cee8702,segment=NetworkSegment(a422b515-4eaf-4235-a3e4-a2fa0790f882),segment_id=a422b515-4eaf-4235-a3e4-a2fa0790f882)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:20:58.186384 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': '826f0333-43b9-4b01-8dc9-95a51cee8702', 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb', 'port_id': '826f0333-43b9-4b01-8dc9-95a51cee8702', 'mac_address': 'fa:16:3e:ad:42:fc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 191, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b7476cdf-e453-4db0-a095-7baf9278351d', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:20:58.199526 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2a0826b7-0b2c-49b3-8662-649ebd8c991d req-03357600-015a-4091-a962-0dcf2161805a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415311 Nov 08 04:20:58.226360 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:58.239417 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 826f0333-43b9-4b01-8dc9-95a51cee8702 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:20:58.258642 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 826f0333-43b9-4b01-8dc9-95a51cee8702, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=826f0333-43b9-4b01-8dc9-95a51cee8702,segment=NetworkSegment(a422b515-4eaf-4235-a3e4-a2fa0790f882),segment_id=a422b515-4eaf-4235-a3e4-a2fa0790f882)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:20:58.339278 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:20:58.387302 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=826f0333-43b9-4b01-8dc9-95a51cee8702,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:20:58.696456 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['826f0333-43b9-4b01-8dc9-95a51cee8702'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:20:59.314558 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c34462-de68-4b46-8bff-c3c827eace63 req-7e5d8773-a90d-4c1a-926a-e73018eec03b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:20:59.316549 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-59c34462-de68-4b46-8bff-c3c827eace63 req-7e5d8773-a90d-4c1a-926a-e73018eec03b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 945 time: 0.0512955 Nov 08 04:20:59.363615 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-59c34462-de68-4b46-8bff-c3c827eace63 req-79ef5063-b748-4792-a74c-04c774977206 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413439 Nov 08 04:21:00.091986 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 826f0333-43b9-4b01-8dc9-95a51cee8702 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:21:00.196310 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port 826f0333-43b9-4b01-8dc9-95a51cee8702 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:21:00.204737 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port 826f0333-43b9-4b01-8dc9-95a51cee8702 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:21:00.206255 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:00.283024 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:00.304621 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '088cdd76-cef5-4177-8847-c4beb1dbb4b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '826f0333-43b9-4b01-8dc9-95a51cee8702'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:21:00.306838 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6074b9fe-ba20-4a91-86f0-18454abb8293" -d '{"events": [{"server_uuid": "088cdd76-cef5-4177-8847-c4beb1dbb4b6", "name": "network-vif-plugged", "status": "completed", "tag": "826f0333-43b9-4b01-8dc9-95a51cee8702"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:21:00.320546 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 826f0333-43b9-4b01-8dc9-95a51cee8702, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=826f0333-43b9-4b01-8dc9-95a51cee8702,segment=NetworkSegment(a422b515-4eaf-4235-a3e4-a2fa0790f882),segment_id=a422b515-4eaf-4235-a3e4-a2fa0790f882)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:21:00.343973 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:21:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-14233fe6-d8b3-46cd-a62b-524b60d72d40 x-openstack-request-id: req-14233fe6-d8b3-46cd-a62b-524b60d72d40 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:21:00.344228 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "088cdd76-cef5-4177-8847-c4beb1dbb4b6", "name": "network-vif-plugged", "status": "completed", "tag": "826f0333-43b9-4b01-8dc9-95a51cee8702", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:21:00.344474 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-14233fe6-d8b3-46cd-a62b-524b60d72d40 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:21:00.344865 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '088cdd76-cef5-4177-8847-c4beb1dbb4b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '826f0333-43b9-4b01-8dc9-95a51cee8702', 'code': 200} Nov 08 04:21:00.396463 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:00.444143 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=826f0333-43b9-4b01-8dc9-95a51cee8702,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:21:00.487493 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93e1de8-c339-4a8b-8ab7-45b8efe7f9d5 req-1a9b28ea-029d-41f0-91e9-470307d06daf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:00.489085 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e93e1de8-c339-4a8b-8ab7-45b8efe7f9d5 req-1a9b28ea-029d-41f0-91e9-470307d06daf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 946 time: 0.0575767 Nov 08 04:21:00.542237 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e93e1de8-c339-4a8b-8ab7-45b8efe7f9d5 req-714be145-f114-40e8-8629-7ad860fbcf57 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468261 Nov 08 04:21:00.736664 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8fead88-d7c0-484a-a624-a02933f21f73 req-96fac541-3fd5-4af4-b728-31072c1e7c65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:00.738145 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b8fead88-d7c0-484a-a624-a02933f21f73 req-96fac541-3fd5-4af4-b728-31072c1e7c65 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 1099 time: 0.0387299 Nov 08 04:21:00.793383 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b8fead88-d7c0-484a-a624-a02933f21f73 req-0bdbb64b-8ca0-4f9b-9cfe-83674336d07b service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398066 Nov 08 04:21:01.660479 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7bc14c8-a84e-4356-9b03-f5f3a0f54555 req-27062fa9-d062-48da-afbf-c82d37dab1a3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:01.661917 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d7bc14c8-a84e-4356-9b03-f5f3a0f54555 req-27062fa9-d062-48da-afbf-c82d37dab1a3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 946 time: 0.0479674 Nov 08 04:21:01.707994 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d7bc14c8-a84e-4356-9b03-f5f3a0f54555 req-137f6760-defb-47ad-bf82-06beddbefa3b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403140 Nov 08 04:21:02.819128 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9161b25d-9aca-4200-a293-37b4b3b388a3 req-58288824-5b70-4ab7-bb3d-c4083487e010 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:02.820569 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9161b25d-9aca-4200-a293-37b4b3b388a3 req-58288824-5b70-4ab7-bb3d-c4083487e010 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 946 time: 0.0473626 Nov 08 04:21:02.865522 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9161b25d-9aca-4200-a293-37b4b3b388a3 req-d11e561e-f61a-4e76-8b81-fdf9977856a0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391014 Nov 08 04:21:12.653163 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-ce35c517-acae-488d-b90d-55d8470dd385 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:13.962785 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:21:15.150046 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7f0c92da-3cc6-41ac-8f59-227de63dbf1c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:15.967109 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:17.624429 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:18.379066 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:24.310307 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:28.673335 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-68d81093-730e-45b8-b7e7-084aa94b2f89 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0422070 Nov 08 04:21:28.749246 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-7ae17b50-af54-4724-b6d5-9cfa4afb418f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:28.751270 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-7ae17b50-af54-4724-b6d5-9cfa4afb418f service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0416741 Nov 08 04:21:28.853948 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-0fac4856-f7cc-4df9-afca-cd4b8a2bcf03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:28.855647 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-0fac4856-f7cc-4df9-afca-cd4b8a2bcf03 service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0840678 Nov 08 04:21:28.924203 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-d9e27590-74c8-4639-b687-1a4f7f7f5d6c service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0612059 Nov 08 04:21:28.975915 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-932c118a-fc7a-4018-9808-2acc10396820 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:28.977352 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-932c118a-fc7a-4018-9808-2acc10396820 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0457611 Nov 08 04:21:29.025903 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-cc7b4b5b-e256-4cc3-b7aa-663cd4712f6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:29.027435 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-cc7b4b5b-e256-4cc3-b7aa-663cd4712f6f service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0391712 Nov 08 04:21:29.121815 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-de85460f-45f0-41d6-9d24-6fd204076ab4 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829701 Nov 08 04:21:29.211419 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ae5f5ce3-b6eb-4752-bd4d-72dfd3090620 req-693462c7-97ad-4f9c-9a08-3a2d3b9c1fbb service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817146 Nov 08 04:21:42.652367 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b0adff7-c02e-4f0b-a930-e82e4d7be382 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:45.144119 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-31abe090-433d-466f-a33f-fc6cbeb13906 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:45.983803 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:47.104680 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df70f09e-21bf-4cc6-aa05-e3e6f0089e90 req-7f344151-8b05-47b4-a5b5-68ff2c530c40 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:47.106532 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df70f09e-21bf-4cc6-aa05-e3e6f0089e90 req-7f344151-8b05-47b4-a5b5-68ff2c530c40 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 946 time: 0.0493002 Nov 08 04:21:47.152968 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df70f09e-21bf-4cc6-aa05-e3e6f0089e90 req-a55aefdd-c99e-4e79-bab9-5f64dab62c76 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405552 Nov 08 04:21:47.618320 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:48.277171 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34567477-b95d-4aeb-9cfc-ba3bcf0166a0 req-f363f74b-07f7-4197-b7de-fcdd1ac806ad tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:48.278664 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34567477-b95d-4aeb-9cfc-ba3bcf0166a0 req-f363f74b-07f7-4197-b7de-fcdd1ac806ad tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 946 time: 0.0528879 Nov 08 04:21:48.329189 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34567477-b95d-4aeb-9cfc-ba3bcf0166a0 req-6467e3f7-149a-4534-864e-f72bb959d046 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444613 Nov 08 04:21:48.372091 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:48.843826 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-e4372aab-ab07-4a1f-876c-e45bf5d0ab15 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:48.845215 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-e4372aab-ab07-4a1f-876c-e45bf5d0ab15 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.16 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 946 time: 0.0503967 Nov 08 04:21:48.932900 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Deleting port 826f0333-43b9-4b01-8dc9-95a51cee8702 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:21:48.933228 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:49.019449 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] For port 826f0333-43b9-4b01-8dc9-95a51cee8702, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=826f0333-43b9-4b01-8dc9-95a51cee8702,segment=NetworkSegment(a422b515-4eaf-4235-a3e4-a2fa0790f882),segment_id=a422b515-4eaf-4235-a3e4-a2fa0790f882)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:21:49.019813 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:49.032152 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Calling delete_port for 826f0333-43b9-4b01-8dc9-95a51cee8702 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:21:49.218351 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:49.245782 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Pushing event deleted for resources: {'Port': ['ID=826f0333-43b9-4b01-8dc9-95a51cee8702,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:21:49.253070 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['826f0333-43b9-4b01-8dc9-95a51cee8702'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:21:49.256135 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.256487 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.256826 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.257163 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.257491 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.257817 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.258141 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.258495 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.259357 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.259682 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.260006 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.260326 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:21:49.296973 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] No DVR routers for this DVR port 826f0333-43b9-4b01-8dc9-95a51cee8702 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:21:49.299441 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:49.302703 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a18ec526-e70d-4935-99f8-4c969f67c66a req-69b0071c-f6a4-4be8-b299-98fd1e9a6d0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.16 "DELETE /v2.0/ports/826f0333-43b9-4b01-8dc9-95a51cee8702 HTTP/1.1" status: 204 len: 173 time: 0.4512825 Nov 08 04:21:49.303141 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '088cdd76-cef5-4177-8847-c4beb1dbb4b6', 'name': 'network-vif-deleted', 'tag': '826f0333-43b9-4b01-8dc9-95a51cee8702'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:21:49.305337 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8dfb4f2a-f7f6-453a-80ed-e8dae2e8c58d" -d '{"events": [{"server_uuid": "088cdd76-cef5-4177-8847-c4beb1dbb4b6", "name": "network-vif-deleted", "tag": "826f0333-43b9-4b01-8dc9-95a51cee8702"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:21:49.406825 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:21:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f83d0403-76ae-4cda-b976-6fb373d8b67a x-openstack-request-id: req-f83d0403-76ae-4cda-b976-6fb373d8b67a {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:21:49.407802 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "088cdd76-cef5-4177-8847-c4beb1dbb4b6", "name": "network-vif-deleted", "tag": "826f0333-43b9-4b01-8dc9-95a51cee8702", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:21:49.407802 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-f83d0403-76ae-4cda-b976-6fb373d8b67a {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:21:49.407802 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '088cdd76-cef5-4177-8847-c4beb1dbb4b6', 'name': 'network-vif-deleted', 'tag': '826f0333-43b9-4b01-8dc9-95a51cee8702', 'status': 'completed', 'code': 200} Nov 08 04:21:49.425331 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e1fa8f1-cebb-405e-9485-6b62f7c619bc req-d91b5823-d6fb-4842-a057-035be3b20ffa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=088cdd76-cef5-4177-8847-c4beb1dbb4b6 HTTP/1.1" status: 200 len: 210 time: 0.0288932 Nov 08 04:21:50.354670 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60342) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:21:50.519930 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Deleting port 0becc41d-4073-4881-a746-9c27b7d19ca7 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:21:50.520269 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:50.597683 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:50.598006 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:50.610697 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Calling delete_port for 0becc41d-4073-4881-a746-9c27b7d19ca7 owned by network:floatingip {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:21:50.858763 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:50.884358 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event deleted for resources: {'Port': ['ID=0becc41d-4073-4881-a746-9c27b7d19ca7,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:21:50.945122 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for floatingip, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:50.945481 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Floating IP 28546093-3395-407b-bf75-6473fba38808 disassociated (deleted). External IP: 172.27.2.222, port: 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a. Nov 08 04:21:50.961393 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:21:51.142073 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Router 8d32ec67-9649-4b0a-b473-c593c138b81b has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:21:51.244424 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:21:51.249203 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:51.254238 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] Sync routers for ids ['8d32ec67-9649-4b0a-b473-c593c138b81b'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:21:51.263667 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] Routers {'8d32ec67-9649-4b0a-b473-c593c138b81b'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:21:51.264366 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:21:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8d32ec67-9649-4b0a-b473-c593c138b81b'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:21:51.275208 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-c9182a76-0059-4fdb-bd51-ee152c7429f7 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "DELETE /v2.0/floatingips/28546093-3395-407b-bf75-6473fba38808 HTTP/1.1" status: 204 len: 168 time: 0.9186780 Nov 08 04:21:51.367843 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] Set router 8d32ec67-9649-4b0a-b473-c593c138b81b gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:21:51.408548 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:21:51.410867 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7cdcee71-6466-4cd8-baba-e4e5552781a1" -d '{"events": [{"name": "network-changed", "server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:21:51.445505 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:21:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60153281-6dcb-4fd6-a17a-e66df6f40fdd x-openstack-request-id: req-60153281-6dcb-4fd6-a17a-e66df6f40fdd {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:21:51.445791 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:21:51.446044 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-60153281-6dcb-4fd6-a17a-e66df6f40fdd {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:21:51.446972 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'status': 'completed', 'code': 200} Nov 08 04:21:51.565392 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0aae4312-8f40-413f-b687-6b651ec25acd', 'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'mac_address': 'fa:16:3e:e1:0b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:06Z', 'updated_at': '2021-11-08T04:17:11Z', 'revision_number': 5, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'subnets': [{'id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:21:51.592162 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] Checking router: 8d32ec67-9649-4b0a-b473-c593c138b81b for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:21:51.600627 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] Routers {'8d32ec67-9649-4b0a-b473-c593c138b81b'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:21:51.601215 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:21:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8d32ec67-9649-4b0a-b473-c593c138b81b'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:21:51.705716 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f480144-bb2f-4641-8e29-4aaef78f865b req-81b8f7fc-6949-44da-8fc3-bf333726c3f8 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:51.707161 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6f480144-bb2f-4641-8e29-4aaef78f865b req-81b8f7fc-6949-44da-8fc3-bf333726c3f8 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0491333 Nov 08 04:21:51.707581 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] Set router 8d32ec67-9649-4b0a-b473-c593c138b81b gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:21:51.756334 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6f480144-bb2f-4641-8e29-4aaef78f865b req-0f6881e1-37fb-4a80-acfd-558f82aa1739 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427520 Nov 08 04:21:51.905340 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0aae4312-8f40-413f-b687-6b651ec25acd', 'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'mac_address': 'fa:16:3e:e1:0b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:06Z', 'updated_at': '2021-11-08T04:17:11Z', 'revision_number': 5, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'subnets': [{'id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:21:51.933958 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64adba19-c8da-455b-bee1-89029a49c106 None None] The sync data for ids ['8d32ec67-9649-4b0a-b473-c593c138b81b'] in dv-cinder-783643-4-iscsi is: [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:07Z', 'revision_number': 4, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '0aae4312-8f40-413f-b687-6b651ec25acd', 'name': '', 'network_id': '6fbc518a-d762-4340-b3c4-10e04086e375', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'mac_address': 'fa:16:3e:e1:0b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_interface', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:06Z', 'updated_at': '2021-11-08T04:17:11Z', 'revision_number': 5, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'subnets': [{'id': 'cde96b9f-aad6-4299-909d-9e2c0a335515', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:21:52.142404 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9042e8f-ece7-4ea1-b47e-90f19f60dba1 None None] New status for floating IP 28546093-3395-407b-bf75-6473fba38808: DOWN {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:21:52.874909 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8afa6de5-b65a-4252-bddc-38c8a3323f13 req-730ceb83-ebe9-465c-9518-bfd89e9d5ea4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:52.876366 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8afa6de5-b65a-4252-bddc-38c8a3323f13 req-730ceb83-ebe9-465c-9518-bfd89e9d5ea4 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0514359 Nov 08 04:21:52.924480 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8afa6de5-b65a-4252-bddc-38c8a3323f13 req-50e80470-6659-468d-aff4-4c872fd782d1 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423026 Nov 08 04:21:53.883175 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 826f0333-43b9-4b01-8dc9-95a51cee8702 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:21:53.904574 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: 826f0333-43b9-4b01-8dc9-95a51cee8702 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:21:53.904921 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 826f0333-43b9-4b01-8dc9-95a51cee8702 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:21:54.031602 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-09e6b01c-80ac-46ef-a70c-6476f5cf144d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:54.033054 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-09e6b01c-80ac-46ef-a70c-6476f5cf144d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=9e6436a3d5084995840a192763eea4ae&device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 1098 time: 0.1178195 Nov 08 04:21:54.045340 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f5a2af3-bbcf-4732-b6af-bd91f1cdfc9e req-9f2157c9-aff1-4b25-846b-353b5559c9fc tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:54.046654 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6f5a2af3-bbcf-4732-b6af-bd91f1cdfc9e req-9f2157c9-aff1-4b25-846b-353b5559c9fc tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0556440 Nov 08 04:21:54.146424 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6f5a2af3-bbcf-4732-b6af-bd91f1cdfc9e req-0e843c07-04c3-4509-8a62-5ed73937a0c1 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0920210 Nov 08 04:21:54.164490 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-4194b59b-b258-4026-b855-23c5e10af10d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:54.165943 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-4194b59b-b258-4026-b855-23c5e10af10d service neutron] 10.222.0.16 "GET /v2.0/networks?id=6fbc518a-d762-4340-b3c4-10e04086e375 HTTP/1.1" status: 200 len: 910 time: 0.1184814 Nov 08 04:21:54.210864 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-71915b91-25e6-490d-9cb8-d54a68fd6a51 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a HTTP/1.1" status: 200 len: 217 time: 0.0370686 Nov 08 04:21:54.260375 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-4451fe84-7ed2-407b-9ea7-ff48679a2b7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:54.261755 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-4451fe84-7ed2-407b-9ea7-ff48679a2b7d service neutron] 10.222.0.16 "GET /v2.0/subnets?id=cde96b9f-aad6-4299-909d-9e2c0a335515 HTTP/1.1" status: 200 len: 848 time: 0.0432942 Nov 08 04:21:54.286464 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:54.306184 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-db7219f3-7899-4e12-9547-5d65263f3297 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:54.307666 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-db7219f3-7899-4e12-9547-5d65263f3297 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=6fbc518a-d762-4340-b3c4-10e04086e375&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0386393 Nov 08 04:21:54.319713 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-a2b2432c-1651-41eb-932f-a2e1da2ac53f service neutron] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:21:54.320638 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-a2b2432c-1651-41eb-932f-a2e1da2ac53f service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0046139 Nov 08 04:21:54.668453 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-4f5b4fe4-120a-4bbd-8540-d8ab5b3f3511 service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3404396 Nov 08 04:21:54.755394 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cdcee71-6466-4cd8-baba-e4e5552781a1 req-acb7d885-9218-4472-9d1d-150720eb4d27 service neutron] 10.222.0.16 "GET /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0788345 Nov 08 04:21:55.269861 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8947c721-ff9b-4d14-9b84-afaad346a017 req-ebcd5090-259b-43e0-8a57-6b3e8c2d91b5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:55.271341 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8947c721-ff9b-4d14-9b84-afaad346a017 req-ebcd5090-259b-43e0-8a57-6b3e8c2d91b5 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0482376 Nov 08 04:21:55.323069 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8947c721-ff9b-4d14-9b84-afaad346a017 req-35d92dca-ea10-4c4a-a307-7fd43a1e63b6 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/security-groups?id=09645d51-409d-4698-ada1-e2a02622f814&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458171 Nov 08 04:21:55.687831 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-b999dfba-4610-40cd-9685-9837e07cf593 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:21:55.689213 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-b999dfba-4610-40cd-9685-9837e07cf593 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.16 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 945 time: 0.0462406 Nov 08 04:21:55.776740 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-f3e4c86a-0245-41bd-b976-f5a168d5e829 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Deleting port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:21:55.777074 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-f3e4c86a-0245-41bd-b976-f5a168d5e829 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:55.864233 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-f3e4c86a-0245-41bd-b976-f5a168d5e829 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] For port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:21:55.864507 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-f3e4c86a-0245-41bd-b976-f5a168d5e829 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:55.877100 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-f3e4c86a-0245-41bd-b976-f5a168d5e829 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Calling delete_port for 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:21:56.063955 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-f3e4c86a-0245-41bd-b976-f5a168d5e829 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:56.088944 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3e4c86a-0245-41bd-b976-f5a168d5e829 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event deleted for resources: {'Port': ['ID=1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:21:56.131417 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-f3e4c86a-0245-41bd-b976-f5a168d5e829 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] No DVR routers for this DVR port 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:21:56.133298 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-f3e4c86a-0245-41bd-b976-f5a168d5e829 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:21:56.136594 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e8a4ba4a-8ea0-4116-b491-1222436654db req-f3e4c86a-0245-41bd-b976-f5a168d5e829 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.16 "DELETE /v2.0/ports/1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a HTTP/1.1" status: 204 len: 173 time: 0.4416020 Nov 08 04:21:56.137023 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'name': 'network-vif-deleted', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:21:56.139348 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aad34bad-9a4b-495b-bc38-be5fddc3f756" -d '{"events": [{"server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "name": "network-vif-deleted", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:21:56.174246 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:21:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03ae603d-b176-47ee-a76d-d7a2625f6970 x-openstack-request-id: req-03ae603d-b176-47ee-a76d-d7a2625f6970 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:21:56.174670 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "29ef3278-30cd-487b-b434-61021d6472ec", "name": "network-vif-deleted", "tag": "1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:21:56.174959 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-03ae603d-b176-47ee-a76d-d7a2625f6970 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:21:56.175389 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29ef3278-30cd-487b-b434-61021d6472ec', 'name': 'network-vif-deleted', 'tag': '1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a', 'status': 'completed', 'code': 200} Nov 08 04:21:56.415294 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-35d1306b-9da0-4c1e-927a-0c081dfaf08f req-982a71bb-44fe-4d26-b127-7f8a1438819b tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 210 time: 0.0263498 Nov 08 04:21:57.520388 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f7f26e85-e3ee-477b-9b3b-2cec381378df req-1641bc7b-b54a-401e-b402-beb3f449c02d tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 210 time: 0.0265706 Nov 08 04:21:58.630721 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e85bce7d-af9b-49ac-aefc-fb1f840a5d88 req-e66b6124-ffea-4626-bad0-0cc398088810 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 210 time: 0.0285335 Nov 08 04:21:59.731235 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a7c01158-b4e7-4dcc-942f-97ee81606192 req-ee64932d-eba5-4158-a5a0-379e962b57c2 tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "GET /v2.0/ports?device_id=29ef3278-30cd-487b-b434-61021d6472ec HTTP/1.1" status: 200 len: 210 time: 0.0258124 Nov 08 04:22:00.378182 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:22:00.400536 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:22:00.400880 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 1ba2b5d5-1cbe-4bf5-832d-4d1c8924ff1a not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:22:00.784704 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 60418) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:00.843577 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:00.868225 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:00.917815 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede87e47-5c27-4442-8892-416ad5427389 req-aeebcce5-fa08-4d71-a015-271a03ceb288 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:00.919305 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-aeebcce5-fa08-4d71-a015-271a03ceb288 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/networks?id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 200 len: 813 time: 0.0993502 Nov 08 04:22:00.936018 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-18b100c5-ce1b-4e6a-96a9-ee7d2794e7cf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/quotas/8e5d49c7aaba44d380042cbff995c227 HTTP/1.1" status: 200 len: 375 time: 0.0104580 Nov 08 04:22:00.974693 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-41bc0113-717d-4109-84cb-2fb99f35d281 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0306778 Nov 08 04:22:00.996325 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:00.999033 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:01.000277 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] 10.222.0.21 "DELETE /v2.0/security-groups/09645d51-409d-4698-ada1-e2a02622f814 HTTP/1.1" status: 204 len: 168 time: 0.2144535 Nov 08 04:22:01.009856 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=09645d51-409d-4698-ada1-e2a02622f814,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:01.017885 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.018232 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.018778 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.019316 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.019652 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.019980 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.020522 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.020898 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.021268 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.021594 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.021918 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.022237 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6428ae2-6b3e-478a-9b11-c4fba2cc2b9c tempest-TestShelveInstance-882125982 tempest-TestShelveInstance-882125982-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:01.029362 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-128bf796-c2ee-4414-a601-982cbaebf182 service neutron] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:22:01.029961 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-128bf796-c2ee-4414-a601-982cbaebf182 service neutron] 10.222.0.21 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0484543 Nov 08 04:22:01.091503 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 60430) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:01.121721 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-1f1c209d-f8a7-401d-bd4c-f7e2c7c41fcc service neutron] 10.222.0.21 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852995 Nov 08 04:22:01.211380 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-db7d9361-d8f4-4d7c-8cf6-ee20858237ce service neutron] 10.222.0.21 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849657 Nov 08 04:22:01.426321 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c2e0d8c-e2ab-496e-9a6e-4e044276cc8c req-e54a1be6-3a79-4843-858a-7b27ceacd409 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0262206 Nov 08 04:22:01.467407 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-703381'] for router_interface, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:01.719794 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] Deleting port 0aae4312-8f40-413f-b687-6b651ec25acd {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:22:01.720236 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:01.795753 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] For port 0aae4312-8f40-413f-b687-6b651ec25acd, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0aae4312-8f40-413f-b687-6b651ec25acd,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:01.796283 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:01.808801 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] Calling delete_port for 0aae4312-8f40-413f-b687-6b651ec25acd owned by network:router_interface {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:22:02.052623 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:02.081457 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] Pushing event deleted for resources: {'Port': ['ID=0aae4312-8f40-413f-b687-6b651ec25acd,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:02.261303 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530978', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-703013'] for router_interface, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:02.473801 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] Router 8d32ec67-9649-4b0a-b473-c593c138b81b has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:22:02.525668 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4a9a2d1e-100a-4d78-8c6b-026162f90a90 req-62a305bf-5bb5-418d-984a-f9e3accc2905 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0261009 Nov 08 04:22:02.598591 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:22:02.604329 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e7de55a8-a214-490a-9875-c3bceb9e2fff admin admin] 10.222.0.21 "PUT /v2.0/routers/8d32ec67-9649-4b0a-b473-c593c138b81b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5109851 Nov 08 04:22:02.607131 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 60446) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:02.610023 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] Sync routers for ids ['8d32ec67-9649-4b0a-b473-c593c138b81b'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:22:02.623911 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] Routers {'8d32ec67-9649-4b0a-b473-c593c138b81b'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:22:02.623911 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:21:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8d32ec67-9649-4b0a-b473-c593c138b81b'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:02.724795 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] Set router 8d32ec67-9649-4b0a-b473-c593c138b81b gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:22:02.760088 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Publish callbacks [] for router, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:02.863388 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:02.919558 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168'}], 'enable_snat': True}, 'gw_port_id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:22:01Z', 'revision_number': 5, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port': {'id': 'a996d7df-a0ce-4dc7-821e-00c39172b3f6', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:16:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 535, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.168', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:17:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:02.944880 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] Checking router: 8d32ec67-9649-4b0a-b473-c593c138b81b for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:22:02.952911 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] Routers {'8d32ec67-9649-4b0a-b473-c593c138b81b'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:22:02.953501 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:21:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8d32ec67-9649-4b0a-b473-c593c138b81b'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:03.001175 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Deleting port a996d7df-a0ce-4dc7-821e-00c39172b3f6 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:22:03.001510 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.037150 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] Set router 8d32ec67-9649-4b0a-b473-c593c138b81b gateway port host: None {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:22:03.079463 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] For port a996d7df-a0ce-4dc7-821e-00c39172b3f6, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=a996d7df-a0ce-4dc7-821e-00c39172b3f6,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:03.080008 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.094333 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Calling delete_port for a996d7df-a0ce-4dc7-821e-00c39172b3f6 owned by network:router_gateway {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:22:03.231507 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:22:02Z', 'revision_number': 6, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port_host': None}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:03.243016 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65418ac4-1791-41e1-9291-fd2418dd9dc5 None None] The sync data for ids ['8d32ec67-9649-4b0a-b473-c593c138b81b'] in dv-cinder-783643-4-iscsi is: [{'id': '8d32ec67-9649-4b0a-b473-c593c138b81b', 'name': 'tempest-TestShelveInstance-1229405597-router', 'tenant_id': '9e6436a3d5084995840a192763eea4ae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:04Z', 'updated_at': '2021-11-08T04:22:02Z', 'revision_number': 6, 'project_id': '9e6436a3d5084995840a192763eea4ae', 'gw_port_host': None}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:22:03.332191 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.364625 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Pushing event deleted for resources: {'Port': ['ID=a996d7df-a0ce-4dc7-821e-00c39172b3f6,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:03.422101 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-688863'] for router_gateway, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.446951 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede87e47-5c27-4442-8892-416ad5427389 req-ec4d6abc-409a-40ca-a52b-afe564c03c96 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:03.447934 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-ec4d6abc-409a-40ca-a52b-afe564c03c96 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.16 "GET /v2.0/networks?id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 200 len: 813 time: 0.1082726 Nov 08 04:22:03.465723 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Request body: {'port': {'device_id': '7e227364-ee79-4f7a-94c6-fca4e0bd3c6d', 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb', 'admin_state_up': True, 'tenant_id': '8e5d49c7aaba44d380042cbff995c227'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:22:03.509682 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-700541', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7524'] for router, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.512292 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.623406 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-700518'] for router, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.623936 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8d32ec67-9649-4b0a-b473-c593c138b81b {{(pid=101664) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 04:22:03.632472 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.637915 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-88fbfeb0-1981-4ab6-b7c5-fd60e006229b admin admin] 10.222.0.21 "DELETE /v2.0/routers/8d32ec67-9649-4b0a-b473-c593c138b81b HTTP/1.1" status: 204 len: 168 time: 1.0275931 Nov 08 04:22:03.638327 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 60452) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:03.648041 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-77a82d13-73ef-426b-89e0-39f363c717c2 req-f95b4c37-7856-4667-99da-31c00141c98a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0399709 Nov 08 04:22:03.652990 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Made reservation on behalf of 8e5d49c7aaba44d380042cbff995c227 for: {'port': 1} {{(pid=101665) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 08 04:22:03.658537 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.719441 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.db_base_plugin_v2 [None req-8bd8d194-962c-42dc-ac4f-a798fa51f096 admin admin] Deleting subnet cde96b9f-aad6-4299-909d-9e2c0a335515 {{(pid=101664) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:22:03.724817 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8bd8d194-962c-42dc-ac4f-a798fa51f096 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.736025 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0aae4312-8f40-413f-b687-6b651ec25acd no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:22:03.761710 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 0aae4312-8f40-413f-b687-6b651ec25acd {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:22:03.761946 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0aae4312-8f40-413f-b687-6b651ec25acd not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:22:03.767763 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8bd8d194-962c-42dc-ac4f-a798fa51f096 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-6285890'] for subnet, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.811533 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_common [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Allocated IP 172.20.0.6 (9f4f71e5-fbed-4c5a-b59e-c195c2501dbb/b7476cdf-e453-4db0-a095-7baf9278351d/eac4c3f2-b319-465e-9c3f-59ea0259a2a3) {{(pid=101665) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 08 04:22:03.847908 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8bd8d194-962c-42dc-ac4f-a798fa51f096 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.955937 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8bd8d194-962c-42dc-ac4f-a798fa51f096 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5121021', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5043596'] for subnet, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.961340 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks [] for port, precommit_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.986194 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bd8d194-962c-42dc-ac4f-a798fa51f096 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cde96b9f-aad6-4299-909d-9e2c0a335515,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:03.988126 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-8bd8d194-962c-42dc-ac4f-a798fa51f096 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for subnet, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:03.996868 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-8bd8d194-962c-42dc-ac4f-a798fa51f096 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/cde96b9f-aad6-4299-909d-9e2c0a335515 HTTP/1.1" status: 204 len: 168 time: 0.3509164 Nov 08 04:22:03.996868 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 60458) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:03.997062 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f13ff705-049a-419b-81fd-7e2815dadda7 None None] Network 6fbc518a-d762-4340-b3c4-10e04086e375 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:22:04.065138 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.070181 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8785435675513', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_create {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.114909 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb is already hosted by enough agents. {{(pid=101665) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 08 04:22:04.121095 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Deleting port a97ab861-3913-4fe9-8e16-f93af362dcd6 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:22:04.121298 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.base_scheduler [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Resources bound (agent type, host, resource id): {{(pid=101665) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 08 04:22:04.121464 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.125434 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Received port after_create {{(pid=101665) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 08 04:22:04.173870 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Pushing event updated for resources: {'Port': ['ID=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,revision_number=1']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:04.197622 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:04.198244 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.206025 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] For port a97ab861-3913-4fe9-8e16-f93af362dcd6, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=a97ab861-3913-4fe9-8e16-f93af362dcd6,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:04.206867 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.218968 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] DHCP port deletion for 6fbc518a-d762-4340-b3c4-10e04086e375 request from dv-cinder-783643-4-iscsi {{(pid=101666) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 04:22:04.222167 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Calling delete_port for a97ab861-3913-4fe9-8e16-f93af362dcd6 owned by network:dhcp {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:22:04.268301 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Deleting port a97ab861-3913-4fe9-8e16-f93af362dcd6 {{(pid=101666) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:22:04.268667 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.273500 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-849c5877-f142-43b0-9d64-c3453d327c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.16 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8120880 Nov 08 04:22:04.294899 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.v2.base [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Request body: {'port': {'device_id': '7e227364-ee79-4f7a-94c6-fca4e0bd3c6d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78364'}} {{(pid=101665) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 08 04:22:04.336136 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] For port a97ab861-3913-4fe9-8e16-f93af362dcd6, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=a97ab861-3913-4fe9-8e16-f93af362dcd6,segment=NetworkSegment(3195749d-d797-4105-b176-934eef1ae577),segment_id=3195749d-d797-4105-b176-934eef1ae577)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:04.336532 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.352294 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Calling delete_port for a97ab861-3913-4fe9-8e16-f93af362dcd6 owned by network:dhcp {{(pid=101666) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:22:04.354240 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.378391 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.420472 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] No DVR routers for this DVR port a97ab861-3913-4fe9-8e16-f93af362dcd6 on host dv-cinder-783643-4-iscsi {{(pid=101664) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:22:04.425744 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Pushing event deleted for resources: {'Port': ['ID=a97ab861-3913-4fe9-8e16-f93af362dcd6,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:04.449111 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522'] for port, after_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.476651 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Pushing event deleted for resources: {'Port': ['ID=a97ab861-3913-4fe9-8e16-f93af362dcd6,revision_number=None']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:04.479837 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] No DVR routers for this DVR port a97ab861-3913-4fe9-8e16-f93af362dcd6 on host dv-cinder-783643-4-iscsi {{(pid=101666) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:22:04.495284 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.495931 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.496325 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.496723 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.497127 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.497538 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.497978 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.498412 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.498824 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.499213 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.499598 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.499981 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84694fcd-d5b6-42d3-b05a-680dc5571b85 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:22:04.636901 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id eac4c3f2-b319-465e-9c3f-59ea0259a2a3 {{(pid=101665) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:22:04.644862 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.657774 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.provisioning_blocks [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Transition to ACTIVE for port object eac4c3f2-b319-465e-9c3f-59ea0259a2a3 will not be triggered until provisioned by entity L2. {{(pid=101665) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 08 04:22:04.703922 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.768113 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.790074 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Pushing event updated for resources: {'Port': ['ID=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,revision_number=2']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:04.790314 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6fbc518a-d762-4340-b3c4-10e04086e375']}} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:04.804334 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3195749d-d797-4105-b176-934eef1ae577') {'for_net_delete': True} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:04.804486 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3195749d-d797-4105-b176-934eef1ae577') {} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:04.814746 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6285915'] for segment, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.829024 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.835864 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Releasing vlan 190 on physical network physnet1 to pool {{(pid=101664) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:22:04.836489 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5120795'] for segment, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: Traceback (most recent call last): Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: timer() Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: cb(*args, **kw) Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: return func(*args, **kwargs) Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: self._notify() Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: self.callback(batched_events) Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: event.method(event) Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: return f(self, *a, **k) Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._get(url).json() Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: return self.request(url, 'GET', **kwargs) Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:22:04.839242 dv-cinder-783643-4-iscsi neutron-server[101664]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:22:04.843774 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c2e741-8e6a-4815-948c-9894d925cb2a req-9a4744a6-1d05-4c24-8911-3cc5845687c5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:04.850877 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02c2e741-8e6a-4815-948c-9894d925cb2a req-9a4744a6-1d05-4c24-8911-3cc5845687c5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 943 time: 0.1158488 Nov 08 04:22:04.917624 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Attempting to bind port eac4c3f2-b319-465e-9c3f-59ea0259a2a3 on host hv-cinder-78364 for vnic_type normal with profile {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 08 04:22:04.917952 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Attempting to bind port eac4c3f2-b319-465e-9c3f-59ea0259a2a3 by drivers openvswitch,hyperv on host hv-cinder-78364 at level 0 using segments [{'id': 'a422b515-4eaf-4235-a3e4-a2fa0790f882', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb'}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 08 04:22:04.918267 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Attempting to bind port eac4c3f2-b319-465e-9c3f-59ea0259a2a3 on network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:22:04.925298 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02c2e741-8e6a-4815-948c-9894d925cb2a req-a587f1de-bb1f-4d88-b9c7-d6742c582497 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736086 Nov 08 04:22:04.926364 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Port eac4c3f2-b319-465e-9c3f-59ea0259a2a3 on network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78364 {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 08 04:22:04.926715 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Attempting to bind port eac4c3f2-b319-465e-9c3f-59ea0259a2a3 on network 9f4f71e5-fbed-4c5a-b59e-c195c2501dbb {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 08 04:22:04.931581 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Checking agent: {'id': '54cb7020-e7b1-4648-a2d9-918c89923b0a', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78364', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'started_at': datetime.datetime(2021, 11, 8, 4, 9, 24), 'heartbeat_timestamp': datetime.datetime(2021, 11, 8, 4, 21, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 08 04:22:04.931957 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Checking segment: {'id': 'a422b515-4eaf-4235-a3e4-a2fa0790f882', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101665) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 08 04:22:04.932333 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Bound using segment: {'id': 'a422b515-4eaf-4235-a3e4-a2fa0790f882', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb'} {{(pid=101665) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 08 04:22:04.932749 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.managers [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Bound port: eac4c3f2-b319-465e-9c3f-59ea0259a2a3, host: hv-cinder-78364, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a422b515-4eaf-4235-a3e4-a2fa0790f882', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 191, 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb'}}] {{(pid=101665) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 08 04:22:04.933099 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.967123 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.981851 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:04.985093 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] 10.222.0.21 "DELETE /v2.0/networks/6fbc518a-d762-4340-b3c4-10e04086e375 HTTP/1.1" status: 204 len: 168 time: 0.9898231 Nov 08 04:22:04.986399 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2ac34e-950a-423a-a65c-d9e5da197433 admin admin] Pushing event deleted for resources: {'Network': ['ID=6fbc518a-d762-4340-b3c4-10e04086e375,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:04.988050 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 60462) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:05.004595 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] For port eac4c3f2-b319-465e-9c3f-59ea0259a2a3, host hv-cinder-78364, cleared binding levels {{(pid=101665) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 08 04:22:05.007827 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] For port eac4c3f2-b319-465e-9c3f-59ea0259a2a3, host hv-cinder-78364, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,segment=NetworkSegment(a422b515-4eaf-4235-a3e4-a2fa0790f882),segment_id=a422b515-4eaf-4235-a3e4-a2fa0790f882)] {{(pid=101665) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 08 04:22:05.058934 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-6273222'] for port, after_update {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:05.093100 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:05.093717 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:05.095416 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] 10.222.0.16 "PUT /v2.0/ports/eac4c3f2-b319-465e-9c3f-59ea0259a2a3 HTTP/1.1" status: 200 len: 1093 time: 0.8061171 Nov 08 04:22:05.097621 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7e227364-ee79-4f7a-94c6-fca4e0bd3c6d', 'tag': 'eac4c3f2-b319-465e-9c3f-59ea0259a2a3'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:22:05.099895 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75efaa89-8f74-46d5-a3fa-c910232553a7" -d '{"events": [{"name": "network-changed", "server_uuid": "7e227364-ee79-4f7a-94c6-fca4e0bd3c6d", "tag": "eac4c3f2-b319-465e-9c3f-59ea0259a2a3"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:22:05.123770 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3014da8-aad3-451d-a099-b075a2a4e362 service neutron] Pushing event updated for resources: {'Port': ['ID=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,revision_number=3']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:05.141838 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:22:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33823d89-8d29-4940-8334-05e7d713847b x-openstack-request-id: req-33823d89-8d29-4940-8334-05e7d713847b {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:22:05.142123 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7e227364-ee79-4f7a-94c6-fca4e0bd3c6d", "tag": "eac4c3f2-b319-465e-9c3f-59ea0259a2a3", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:22:05.142568 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-33823d89-8d29-4940-8334-05e7d713847b {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:22:05.142798 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7e227364-ee79-4f7a-94c6-fca4e0bd3c6d', 'tag': 'eac4c3f2-b319-465e-9c3f-59ea0259a2a3', 'status': 'completed', 'code': 200} Nov 08 04:22:05.226018 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75efaa89-8f74-46d5-a3fa-c910232553a7 req-d523b1ee-8016-4f9d-ba43-0b883319fb50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:05.227744 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-75efaa89-8f74-46d5-a3fa-c910232553a7 req-d523b1ee-8016-4f9d-ba43-0b883319fb50 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 1096 time: 0.0423205 Nov 08 04:22:05.338295 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-703381'] for router_interface, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:05.341466 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75efaa89-8f74-46d5-a3fa-c910232553a7 req-9e3cc704-52aa-4611-8509-a4dddbf09946 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:05.342445 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device a996d7df-a0ce-4dc7-821e-00c39172b3f6 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:22:05.342938 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-75efaa89-8f74-46d5-a3fa-c910232553a7 req-9e3cc704-52aa-4611-8509-a4dddbf09946 service neutron] 10.222.0.16 "GET /v2.0/networks?tenant_id=8e5d49c7aaba44d380042cbff995c227&shared=False HTTP/1.1" status: 200 len: 914 time: 0.1021392 Nov 08 04:22:05.366295 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: a996d7df-a0ce-4dc7-821e-00c39172b3f6 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:22:05.366594 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device a996d7df-a0ce-4dc7-821e-00c39172b3f6 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:22:05.367036 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device a97ab861-3913-4fe9-8e16-f93af362dcd6 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:22:05.390349 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: a97ab861-3913-4fe9-8e16-f93af362dcd6 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:22:05.390734 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device a97ab861-3913-4fe9-8e16-f93af362dcd6 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:22:05.446828 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75efaa89-8f74-46d5-a3fa-c910232553a7 req-aac1e991-c249-434d-bee3-ed4e924445e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:05.449009 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-75efaa89-8f74-46d5-a3fa-c910232553a7 req-aac1e991-c249-434d-bee3-ed4e924445e4 service neutron] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0990446 Nov 08 04:22:05.546501 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede87e47-5c27-4442-8892-416ad5427389 req-9aa1a931-214b-45db-80b8-affcb9bbd4dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:05.548060 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-9aa1a931-214b-45db-80b8-affcb9bbd4dc service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 1096 time: 0.0417490 Nov 08 04:22:05.579467 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] Deleting port 560584d8-1630-4840-bcc5-e1e836772de5 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:22:05.579812 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:05.598764 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-f48c5fa1-249c-4fec-8e6e-a1c72bc4b5b2 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3 HTTP/1.1" status: 200 len: 217 time: 0.0344260 Nov 08 04:22:05.647184 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede87e47-5c27-4442-8892-416ad5427389 req-9d934489-880b-4eb4-b5fc-b521ff6f04f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:05.648540 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-9d934489-880b-4eb4-b5fc-b521ff6f04f8 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b7476cdf-e453-4db0-a095-7baf9278351d HTTP/1.1" status: 200 len: 853 time: 0.0423682 Nov 08 04:22:05.661722 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] For port 560584d8-1630-4840-bcc5-e1e836772de5, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=560584d8-1630-4840-bcc5-e1e836772de5,segment=NetworkSegment(96d21411-2303-43dc-b36f-5eeb64f10618),segment_id=96d21411-2303-43dc-b36f-5eeb64f10618)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:05.662114 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:05.675076 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] Calling delete_port for 560584d8-1630-4840-bcc5-e1e836772de5 owned by network:router_interface {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:22:05.684451 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-993884c6-fbd6-4127-8ea5-615762a38fe1 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0283763 Nov 08 04:22:05.773460 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-68e9f216-f666-4c3e-98a8-7621b59cfafb service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813348 Nov 08 04:22:05.865959 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede87e47-5c27-4442-8892-416ad5427389 req-580d0789-9bd2-4e7f-9c2d-65ba2949afac service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844259 Nov 08 04:22:05.887095 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:05.913685 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] Pushing event deleted for resources: {'Port': ['ID=560584d8-1630-4840-bcc5-e1e836772de5,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:06.047798 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd2872fc-6cf8-4b7e-8840-350d1ca397ad req-8dc3c599-f805-41fd-8262-084bf4c47cf2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:06.051093 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dd2872fc-6cf8-4b7e-8840-350d1ca397ad req-8dc3c599-f805-41fd-8262-084bf4c47cf2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 943 time: 0.0557187 Nov 08 04:22:06.083124 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530978', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-703013'] for router_interface, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:06.099341 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dd2872fc-6cf8-4b7e-8840-350d1ca397ad req-c3ab9bf1-1a99-4e87-83a0-d8522ebb3bfb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433853 Nov 08 04:22:06.290000 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] Router 005f8227-4f38-43f7-815b-59ac1a7067a5 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101664) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:22:06.391585 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101664) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:22:06.396537 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-001287da-7927-40b7-a786-6c4cd8317c25 admin admin] 10.222.0.21 "PUT /v2.0/routers/005f8227-4f38-43f7-815b-59ac1a7067a5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4074936 Nov 08 04:22:06.398939 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 60468) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:06.402088 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] Sync routers for ids ['005f8227-4f38-43f7-815b-59ac1a7067a5'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:22:06.412260 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] Routers {'005f8227-4f38-43f7-815b-59ac1a7067a5'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:22:06.412902 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:21:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['005f8227-4f38-43f7-815b-59ac1a7067a5'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:06.499393 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Publish callbacks [] for router, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:06.516267 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] Set router 005f8227-4f38-43f7-815b-59ac1a7067a5 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:22:06.604344 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:06.695282 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'name': 'tempest-TestShelveInstance-32901558-router', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53'}], 'enable_snat': True}, 'gw_port_id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:10Z', 'updated_at': '2021-11-08T04:22:05Z', 'revision_number': 5, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'gw_port': {'id': 'ec70deab-e8f7-45bb-96f1-847a03824b96', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:7b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 547, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:17:11Z', 'updated_at': '2021-11-08T04:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:06.711731 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Deleting port ec70deab-e8f7-45bb-96f1-847a03824b96 {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:22:06.712071 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:06.721983 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] Checking router: 005f8227-4f38-43f7-815b-59ac1a7067a5 for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:22:06.730383 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] Routers {'005f8227-4f38-43f7-815b-59ac1a7067a5'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:22:06.731030 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:21:45Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['005f8227-4f38-43f7-815b-59ac1a7067a5'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:06.793540 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] For port ec70deab-e8f7-45bb-96f1-847a03824b96, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=ec70deab-e8f7-45bb-96f1-847a03824b96,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:06.793923 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:06.808380 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Calling delete_port for ec70deab-e8f7-45bb-96f1-847a03824b96 owned by network:router_gateway {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:22:06.898834 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] Set router 005f8227-4f38-43f7-815b-59ac1a7067a5 gateway port host: None {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:22:06.949488 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'name': 'tempest-TestShelveInstance-32901558-router', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:10Z', 'updated_at': '2021-11-08T04:22:06Z', 'revision_number': 6, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'gw_port_host': None}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:06.977281 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28a5487f-f8c3-4bf5-b934-c10656796398 None None] The sync data for ids ['005f8227-4f38-43f7-815b-59ac1a7067a5'] in dv-cinder-783643-4-iscsi is: [{'id': '005f8227-4f38-43f7-815b-59ac1a7067a5', 'name': 'tempest-TestShelveInstance-32901558-router', 'tenant_id': 'feaf2b62333641368f5719dbadce824f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:17:10Z', 'updated_at': '2021-11-08T04:22:06Z', 'revision_number': 6, 'project_id': 'feaf2b62333641368f5719dbadce824f', 'gw_port_host': None}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:22:07.023286 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.046564 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Pushing event deleted for resources: {'Port': ['ID=ec70deab-e8f7-45bb-96f1-847a03824b96,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:07.106642 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-688863'] for router_gateway, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.194566 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-700541', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7524'] for router, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.196662 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.214739 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025c7c3d-a63a-44b9-a55d-6097a5d9c95c req-58c0ab98-d136-424d-8e38-b1df4e601c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:07.216384 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-025c7c3d-a63a-44b9-a55d-6097a5d9c95c req-58c0ab98-d136-424d-8e38-b1df4e601c92 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 943 time: 0.0478747 Nov 08 04:22:07.267084 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-025c7c3d-a63a-44b9-a55d-6097a5d9c95c req-211bce66-1c48-46c1-acf2-4961e7506bef tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446365 Nov 08 04:22:07.317335 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-700518'] for router, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.318036 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 005f8227-4f38-43f7-815b-59ac1a7067a5 {{(pid=101664) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 04:22:07.324466 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] Publish callbacks [] for router, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.324466 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-4244b9a8-19a9-432c-aab5-ee5187bef028 admin admin] 10.222.0.21 "DELETE /v2.0/routers/005f8227-4f38-43f7-815b-59ac1a7067a5 HTTP/1.1" status: 204 len: 168 time: 0.9243429 Nov 08 04:22:07.328479 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60472) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:07.379253 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_v2 [None req-f68e1918-abfc-458e-a4c4-a8954a783b86 admin admin] Deleting subnet 6bbd9ae0-de11-4b7d-a466-be22da39973f {{(pid=101665) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:22:07.382704 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f68e1918-abfc-458e-a4c4-a8954a783b86 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.422472 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f68e1918-abfc-458e-a4c4-a8954a783b86 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4636238'] for subnet, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.436348 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 560584d8-1630-4840-bcc5-e1e836772de5 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:22:07.456216 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 560584d8-1630-4840-bcc5-e1e836772de5 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:22:07.456484 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 560584d8-1630-4840-bcc5-e1e836772de5 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:22:07.503560 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f68e1918-abfc-458e-a4c4-a8954a783b86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.629869 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f68e1918-abfc-458e-a4c4-a8954a783b86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6273036', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4372241'] for subnet, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.655095 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68e1918-abfc-458e-a4c4-a8954a783b86 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6bbd9ae0-de11-4b7d-a466-be22da39973f,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:07.658769 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f68e1918-abfc-458e-a4c4-a8954a783b86 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.662150 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f68e1918-abfc-458e-a4c4-a8954a783b86 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/6bbd9ae0-de11-4b7d-a466-be22da39973f HTTP/1.1" status: 204 len: 168 time: 0.3340685 Nov 08 04:22:07.664375 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60474) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:07.667646 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6edf85f4-c9cd-4346-ad1a-c98af7db3514 None None] Network 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:22:07.730038 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.793522 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Deleting port 0cb67928-147b-4619-9679-bd929dadb50d {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:22:07.793968 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.830929 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4dbae67-8b6a-471e-8507-0866e27d22de None None] DHCP port deletion for 40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 request from dv-cinder-783643-4-iscsi {{(pid=101666) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 04:22:07.858832 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] For port 0cb67928-147b-4619-9679-bd929dadb50d, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0cb67928-147b-4619-9679-bd929dadb50d,segment=NetworkSegment(96d21411-2303-43dc-b36f-5eeb64f10618),segment_id=96d21411-2303-43dc-b36f-5eeb64f10618)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:07.859137 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.872126 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Calling delete_port for 0cb67928-147b-4619-9679-bd929dadb50d owned by network:dhcp {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:22:07.878353 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-d4dbae67-8b6a-471e-8507-0866e27d22de None None] Deleting port 0cb67928-147b-4619-9679-bd929dadb50d {{(pid=101666) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:22:07.878748 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d4dbae67-8b6a-471e-8507-0866e27d22de None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.944733 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-d4dbae67-8b6a-471e-8507-0866e27d22de None None] For port 0cb67928-147b-4619-9679-bd929dadb50d, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0cb67928-147b-4619-9679-bd929dadb50d,segment=NetworkSegment(96d21411-2303-43dc-b36f-5eeb64f10618),segment_id=96d21411-2303-43dc-b36f-5eeb64f10618)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:07.945128 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d4dbae67-8b6a-471e-8507-0866e27d22de None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:07.957956 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-d4dbae67-8b6a-471e-8507-0866e27d22de None None] Calling delete_port for 0cb67928-147b-4619-9679-bd929dadb50d owned by network:dhcp {{(pid=101666) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:22:08.035230 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.043415 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d4dbae67-8b6a-471e-8507-0866e27d22de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522'] for port, after_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.062561 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Pushing event deleted for resources: {'Port': ['ID=0cb67928-147b-4619-9679-bd929dadb50d,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:08.065826 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] No DVR routers for this DVR port 0cb67928-147b-4619-9679-bd929dadb50d on host dv-cinder-783643-4-iscsi {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:22:08.069096 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4dbae67-8b6a-471e-8507-0866e27d22de None None] Pushing event deleted for resources: {'Port': ['ID=0cb67928-147b-4619-9679-bd929dadb50d,revision_number=None']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:08.070955 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4dbae67-8b6a-471e-8507-0866e27d22de None None] No DVR routers for this DVR port 0cb67928-147b-4619-9679-bd929dadb50d on host dv-cinder-783643-4-iscsi {{(pid=101666) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:22:08.137075 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.156320 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7']}} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:08.165175 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '96d21411-2303-43dc-b36f-5eeb64f10618') {'for_net_delete': True} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:08.165460 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '96d21411-2303-43dc-b36f-5eeb64f10618') {} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:08.174622 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4636247'] for segment, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.187262 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.192875 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Releasing vlan 198 on physical network physnet1 to pool {{(pid=101665) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:22:08.193242 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6273258'] for segment, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: Traceback (most recent call last): Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: timer() Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: cb(*args, **kw) Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: return func(*args, **kwargs) Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: self._notify() Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: self.callback(batched_events) Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: event.method(event) Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: return f(self, *a, **k) Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._get(url).json() Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: return self.request(url, 'GET', **kwargs) Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:22:08.194855 dv-cinder-783643-4-iscsi neutron-server[101665]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:22:08.309542 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.315053 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.318452 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] 10.222.0.21 "DELETE /v2.0/networks/40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7 HTTP/1.1" status: 204 len: 168 time: 0.6531434 Nov 08 04:22:08.331119 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc92b791-eb07-4fee-b53c-48a0a61d19ec admin admin] Pushing event deleted for resources: {'Network': ['ID=40b489ef-f1b7-4824-bbd2-c8ee7bb7cff7,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:08.390096 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48705a43-95c9-44c5-99b5-ff04ec26185a req-217c6da1-b136-4421-9539-1a3e0d4c675b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:08.391584 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48705a43-95c9-44c5-99b5-ff04ec26185a req-217c6da1-b136-4421-9539-1a3e0d4c675b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 943 time: 0.0527217 Nov 08 04:22:08.424853 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device eac4c3f2-b319-465e-9c3f-59ea0259a2a3 details requested by agent hyperv_hv-cinder-78364 with host hv-cinder-78364 {{(pid=101666) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 08 04:22:08.439111 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48705a43-95c9-44c5-99b5-ff04ec26185a req-b1dc9130-8701-4fdd-b87b-15754cae8f15 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416322 Nov 08 04:22:08.522591 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port eac4c3f2-b319-465e-9c3f-59ea0259a2a3, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,segment=NetworkSegment(a422b515-4eaf-4235-a3e4-a2fa0790f882),segment_id=a422b515-4eaf-4235-a3e4-a2fa0790f882)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:08.533420 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Returning: {'device': 'eac4c3f2-b319-465e-9c3f-59ea0259a2a3', 'network_id': '9f4f71e5-fbed-4c5a-b59e-c195c2501dbb', 'port_id': 'eac4c3f2-b319-465e-9c3f-59ea0259a2a3', 'mac_address': 'fa:16:3e:aa:2e:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 191, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b7476cdf-e453-4db0-a095-7baf9278351d', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101666) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 08 04:22:08.574420 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.587054 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id eac4c3f2-b319-465e-9c3f-59ea0259a2a3 {{(pid=101666) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 08 04:22:08.610321 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port eac4c3f2-b319-465e-9c3f-59ea0259a2a3, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,segment=NetworkSegment(a422b515-4eaf-4235-a3e4-a2fa0790f882),segment_id=a422b515-4eaf-4235-a3e4-a2fa0790f882)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:08.632699 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60480) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:08.669683 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.670899 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-25db3d2c-ebb7-4435-8746-6566edd6ad01 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=9e6436a3d5084995840a192763eea4ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0370162 Nov 08 04:22:08.673242 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60482) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:08.719023 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-dbce2fc9-3e86-4556-a855-e1416cbf5a3d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.719640 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,revision_number=4']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:08.740890 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-dbce2fc9-3e86-4556-a855-e1416cbf5a3d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.841030 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-dbce2fc9-3e86-4556-a855-e1416cbf5a3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.843478 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-dbce2fc9-3e86-4556-a855-e1416cbf5a3d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:08.844598 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-dbce2fc9-3e86-4556-a855-e1416cbf5a3d admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/0598b459-c037-4092-ba8c-923aa094a625 HTTP/1.1" status: 204 len: 168 time: 0.1704462 Nov 08 04:22:08.852427 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbce2fc9-3e86-4556-a855-e1416cbf5a3d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0598b459-c037-4092-ba8c-923aa094a625,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:08.983561 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['eac4c3f2-b319-465e-9c3f-59ea0259a2a3'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:22:09.340130 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0cb67928-147b-4619-9679-bd929dadb50d no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:22:09.363883 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 0cb67928-147b-4619-9679-bd929dadb50d {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:22:09.364145 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0cb67928-147b-4619-9679-bd929dadb50d not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:22:09.365095 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device ec70deab-e8f7-45bb-96f1-847a03824b96 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:22:09.383258 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: ec70deab-e8f7-45bb-96f1-847a03824b96 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:22:09.383596 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device ec70deab-e8f7-45bb-96f1-847a03824b96 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:22:09.456743 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 60488) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:09.497268 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-9d6b8b1a-805b-4eda-a779-028c99a2dc65 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=feaf2b62333641368f5719dbadce824f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0392318 Nov 08 04:22:09.499822 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 60492) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:09.547504 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-74bad9c6-00a5-4499-9b6b-65b04c27d918 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:09.556968 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67de8b5f-49a2-4b38-acaa-11cc979567b6 req-374146ed-a75f-4c23-887a-6b9acbc1fdd6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:09.558443 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-67de8b5f-49a2-4b38-acaa-11cc979567b6 req-374146ed-a75f-4c23-887a-6b9acbc1fdd6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 944 time: 0.0519483 Nov 08 04:22:09.569250 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-74bad9c6-00a5-4499-9b6b-65b04c27d918 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:09.606889 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-67de8b5f-49a2-4b38-acaa-11cc979567b6 req-22ee7b8c-0ab1-4c42-b8f5-af46a6581f00 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424306 Nov 08 04:22:09.698893 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-74bad9c6-00a5-4499-9b6b-65b04c27d918 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:09.701520 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-74bad9c6-00a5-4499-9b6b-65b04c27d918 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:09.702702 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-74bad9c6-00a5-4499-9b6b-65b04c27d918 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/371086ce-2771-42d8-84b1-8022640364e7 HTTP/1.1" status: 204 len: 168 time: 0.2019153 Nov 08 04:22:09.710231 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74bad9c6-00a5-4499-9b6b-65b04c27d918 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=371086ce-2771-42d8-84b1-8022640364e7,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:10.441078 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device eac4c3f2-b319-465e-9c3f-59ea0259a2a3 up at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 08 04:22:10.607446 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning for port eac4c3f2-b319-465e-9c3f-59ea0259a2a3 completed by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 08 04:22:10.613270 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.provisioning_blocks [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Provisioning complete for port eac4c3f2-b319-465e-9c3f-59ea0259a2a3 triggered by entity L2. {{(pid=101666) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 08 04:22:10.613633 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1924310'] for port, provisioning_complete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:10.720817 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cbc7ec8-a500-4e01-b4f4-084e2753d164 req-4e8fa0dd-70c4-4f34-a08d-0aab4a439d50 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:10.722267 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0cbc7ec8-a500-4e01-b4f4-084e2753d164 req-4e8fa0dd-70c4-4f34-a08d-0aab4a439d50 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 944 time: 0.0484214 Nov 08 04:22:10.748477 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:10.770437 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0cbc7ec8-a500-4e01-b4f4-084e2753d164 req-d6b0b50d-e786-4ac9-bc6e-240c7abfc2c8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422547 Nov 08 04:22:10.771148 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7e227364-ee79-4f7a-94c6-fca4e0bd3c6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eac4c3f2-b319-465e-9c3f-59ea0259a2a3'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:22:10.773275 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18293ca3-237e-4bcd-b17b-3407fa999df9" -d '{"events": [{"server_uuid": "7e227364-ee79-4f7a-94c6-fca4e0bd3c6d", "name": "network-vif-plugged", "status": "completed", "tag": "eac4c3f2-b319-465e-9c3f-59ea0259a2a3"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:22:10.786204 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port eac4c3f2-b319-465e-9c3f-59ea0259a2a3, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,segment=NetworkSegment(a422b515-4eaf-4235-a3e4-a2fa0790f882),segment_id=a422b515-4eaf-4235-a3e4-a2fa0790f882)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:10.851740 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:10.899765 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,revision_number=5']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:10.981896 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:22:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09f102f4-8080-4f17-b98a-d8f381cadae5 x-openstack-request-id: req-09f102f4-8080-4f17-b98a-d8f381cadae5 {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:22:10.982190 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7e227364-ee79-4f7a-94c6-fca4e0bd3c6d", "name": "network-vif-plugged", "status": "completed", "tag": "eac4c3f2-b319-465e-9c3f-59ea0259a2a3", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:22:10.982442 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-09f102f4-8080-4f17-b98a-d8f381cadae5 {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:22:10.982867 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7e227364-ee79-4f7a-94c6-fca4e0bd3c6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eac4c3f2-b319-465e-9c3f-59ea0259a2a3', 'code': 200} Nov 08 04:22:11.272068 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcd39714-64ba-4531-a6a7-beb7d754e59f req-0d235231-215f-44da-a7f2-4dc75f64da9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:11.273388 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fcd39714-64ba-4531-a6a7-beb7d754e59f req-0d235231-215f-44da-a7f2-4dc75f64da9b service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 1098 time: 0.0367551 Nov 08 04:22:11.319061 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fcd39714-64ba-4531-a6a7-beb7d754e59f req-b58d7a3d-f95a-4fab-9993-a491a36f9892 service neutron] 10.222.0.16 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381649 Nov 08 04:22:11.883008 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62938c89-28d1-4e40-a24f-1e152f9015f7 req-b01f8c3f-c41f-4d2c-9045-e6854948718e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:11.884338 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62938c89-28d1-4e40-a24f-1e152f9015f7 req-b01f8c3f-c41f-4d2c-9045-e6854948718e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0471592 Nov 08 04:22:11.930195 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62938c89-28d1-4e40-a24f-1e152f9015f7 req-e21f727d-3f6f-455b-9bce-d1b5d63ad403 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395079 Nov 08 04:22:12.680928 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-0287d33a-718b-4e23-b49e-5efbe9ca92ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:13.043984 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-237bc77e-6f1d-489d-8c67-448c7de32bfd req-c48ad401-cfa8-42a3-8e82-04e4698c83bd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:13.045427 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-237bc77e-6f1d-489d-8c67-448c7de32bfd req-c48ad401-cfa8-42a3-8e82-04e4698c83bd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0473599 Nov 08 04:22:13.091500 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-237bc77e-6f1d-489d-8c67-448c7de32bfd req-6bec76b6-b4d8-4ab6-b70c-d07b9cdf64ee tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401261 Nov 08 04:22:15.138153 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-895a2a79-2c71-4658-bb22-0ca3bd298ef1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:15.977993 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:17.606989 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:18.383856 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:19.200604 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 60526) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:22:19.353806 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Deleting port 60176f8f-dab7-4beb-bb55-92943947e592 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:22:19.354143 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:19.426449 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:19.426720 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:19.437818 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Calling delete_port for 60176f8f-dab7-4beb-bb55-92943947e592 owned by network:floatingip {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:22:19.652447 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:19.677619 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event deleted for resources: {'Port': ['ID=60176f8f-dab7-4beb-bb55-92943947e592,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:19.737245 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:19.737567 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Floating IP 20fefe9a-4bb5-45ce-b163-6b2fe4da3eaf disassociated (deleted). External IP: 172.27.2.240, port: 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0. Nov 08 04:22:19.929524 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Router 8aa2c265-b728-4ac3-97de-f276d80d2037 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:22:20.031168 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:22:20.035914 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:20.040565 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] Sync routers for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:22:20.050383 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:22:20.051025 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:22:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:20.064209 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-fac70e54-2299-41e1-801c-6dba5af0cc20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "DELETE /v2.0/floatingips/20fefe9a-4bb5-45ce-b163-6b2fe4da3eaf HTTP/1.1" status: 204 len: 168 time: 0.8625314 Nov 08 04:22:20.064779 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:22:20.067042 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-599a300d-da82-4393-8587-9c81ae1142cd" -d '{"events": [{"name": "network-changed", "server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:22:20.106098 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:22:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22b29030-442d-4d8d-a805-ff2693ecb7e5 x-openstack-request-id: req-22b29030-442d-4d8d-a805-ff2693ecb7e5 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:22:20.106896 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:22:20.107173 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-22b29030-442d-4d8d-a805-ff2693ecb7e5 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:22:20.107550 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'status': 'completed', 'code': 200} Nov 08 04:22:20.161851 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:22:20.212566 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-599a300d-da82-4393-8587-9c81ae1142cd req-58aa66b4-7f5e-4f3e-9ba6-426bf49628d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:20.214093 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-599a300d-da82-4393-8587-9c81ae1142cd req-58aa66b4-7f5e-4f3e-9ba6-426bf49628d4 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 1098 time: 0.0556624 Nov 08 04:22:20.308861 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-599a300d-da82-4393-8587-9c81ae1142cd req-15ae14d9-f949-4783-92a1-fca4ad6abc3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:20.310966 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-599a300d-da82-4393-8587-9c81ae1142cd req-15ae14d9-f949-4783-92a1-fca4ad6abc3b service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0898209 Nov 08 04:22:20.356171 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-599a300d-da82-4393-8587-9c81ae1142cd req-bc3f4198-aa4b-4bb6-af27-5a0e41d6bb45 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 HTTP/1.1" status: 200 len: 217 time: 0.0387235 Nov 08 04:22:20.395053 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '00ce2f97-4322-45b8-8cd1-e53e8e1e43b6', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:24:43:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:18:28Z', 'updated_at': '2021-11-08T04:18:30Z', 'revision_number': 1, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:20.422927 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] Checking router: 8aa2c265-b728-4ac3-97de-f276d80d2037 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:22:20.431313 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:22:20.431910 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:22:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:20.439318 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-599a300d-da82-4393-8587-9c81ae1142cd req-11442aa7-a354-44cb-86ce-230b41069b35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:20.440671 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-599a300d-da82-4393-8587-9c81ae1142cd req-11442aa7-a354-44cb-86ce-230b41069b35 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0751522 Nov 08 04:22:20.458488 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01f18421-7c34-41d6-9d0b-20604bfc5172 req-4218caae-0b4e-4061-acec-cb70e2103747 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:20.459893 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-01f18421-7c34-41d6-9d0b-20604bfc5172 req-4218caae-0b4e-4061-acec-cb70e2103747 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 945 time: 0.0552385 Nov 08 04:22:20.534009 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-599a300d-da82-4393-8587-9c81ae1142cd req-792db496-a762-433b-8ef6-4da7733a4149 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:20.535511 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-599a300d-da82-4393-8587-9c81ae1142cd req-792db496-a762-433b-8ef6-4da7733a4149 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0747969 Nov 08 04:22:20.540818 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-01f18421-7c34-41d6-9d0b-20604bfc5172 req-eb58f500-9733-4559-a042-41dd7f6fd011 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0722570 Nov 08 04:22:20.632820 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-599a300d-da82-4393-8587-9c81ae1142cd req-555223f7-eede-49b8-bc96-cda36112ec5d service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865905 Nov 08 04:22:20.668109 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:22:20.730881 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-599a300d-da82-4393-8587-9c81ae1142cd req-919f9df2-87c8-4093-82ca-d9134aa99ab0 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887380 Nov 08 04:22:20.889002 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '00ce2f97-4322-45b8-8cd1-e53e8e1e43b6', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:24:43:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:18:28Z', 'updated_at': '2021-11-08T04:18:30Z', 'revision_number': 1, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:22:20.918377 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc1f15ce-dff5-4554-97bb-1cb4cd5e0bd2 None None] The sync data for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi is: [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_floatingips': [{'id': '00ce2f97-4322-45b8-8cd1-e53e8e1e43b6', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'floating_ip_address': '172.27.2.47', 'floating_network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'router_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'port_id': '5ed549ab-2a42-442b-87e0-565478b5a012', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'mac_address': 'fa:16:3e:24:43:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d56d482-c782-406d-84dd-036e79b29b4a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-08T04:18:28Z', 'updated_at': '2021-11-08T04:18:30Z', 'revision_number': 1, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:22:21.139425 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf23bdfa-1254-45fd-91e7-66c272c592d4 None None] New status for floating IP 20fefe9a-4bb5-45ce-b163-6b2fe4da3eaf: DOWN {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:22:21.665027 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e89a8f84-cc68-4275-a377-8326fc56ee52 req-9511203f-c65c-4926-a12e-43fa493284c4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:21.666505 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e89a8f84-cc68-4275-a377-8326fc56ee52 req-9511203f-c65c-4926-a12e-43fa493284c4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 945 time: 0.0527256 Nov 08 04:22:21.715532 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e89a8f84-cc68-4275-a377-8326fc56ee52 req-f03bc15b-9350-4471-9d5f-287f4beb2239 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424399 Nov 08 04:22:22.832232 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af650a78-7bc1-4883-90cf-a61c5f725ca2 req-3b69077e-d4b7-48e7-939d-eb4fc08abfd3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:22.834277 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af650a78-7bc1-4883-90cf-a61c5f725ca2 req-3b69077e-d4b7-48e7-939d-eb4fc08abfd3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 945 time: 0.0515630 Nov 08 04:22:22.887414 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-af650a78-7bc1-4883-90cf-a61c5f725ca2 req-1f26ca28-ddc4-4381-b988-a2b10600220c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470016 Nov 08 04:22:24.266981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da1577a-2654-4154-9cc2-629dcb438b82 req-5a576f35-a3de-4f37-9fab-32364332d2e4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:24.268352 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6da1577a-2654-4154-9cc2-629dcb438b82 req-5a576f35-a3de-4f37-9fab-32364332d2e4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 945 time: 0.3157470 Nov 08 04:22:24.316978 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6da1577a-2654-4154-9cc2-629dcb438b82 req-24858010-27cf-48c4-8dea-738f15cfe7d7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424337 Nov 08 04:22:24.321002 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:25.426543 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52377a00-096a-4147-9044-6f24b5f586b0 req-c7e9fe6f-79aa-4f82-ba53-090c4b987acb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:25.427959 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-52377a00-096a-4147-9044-6f24b5f586b0 req-c7e9fe6f-79aa-4f82-ba53-090c4b987acb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 945 time: 0.0470240 Nov 08 04:22:25.475763 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-52377a00-096a-4147-9044-6f24b5f586b0 req-2534fe01-ea2e-415e-bb12-e74994e7f836 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419459 Nov 08 04:22:26.488599 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:22:26.566079 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1631262'] for port, before_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:26.592374 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4967c968-6cca-4a6c-b2d7-4ecd3b52edae req-f5ae7755-0081-4208-87ea-9a8f679f45c5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:26.593895 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4967c968-6cca-4a6c-b2d7-4ecd3b52edae req-f5ae7755-0081-4208-87ea-9a8f679f45c5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 945 time: 0.0513835 Nov 08 04:22:26.600774 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0'}] {{(pid=101666) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:22:26.603070 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53b1187a5bf1af768a5dbbd233fe8407eb86e46fc67c5b5efb8ca207c7148164" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d96f3fac-dfd1-4ac2-b168-164aa83a38a7" -d '{"events": [{"server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "name": "network-vif-unplugged", "status": "completed", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0"}]}' {{(pid=101666) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:22:26.607215 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] For port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:22:26.642291 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 08 Nov 2021 04:22:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cf65af0f-57b8-485e-ab80-56dc9cfdaf7f x-openstack-request-id: req-cf65af0f-57b8-485e-ab80-56dc9cfdaf7f {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:22:26.642605 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "name": "network-vif-unplugged", "status": "completed", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0", "code": 200}]} {{(pid=101666) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:22:26.642860 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-cf65af0f-57b8-485e-ab80-56dc9cfdaf7f {{(pid=101666) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:22:26.643243 dv-cinder-783643-4-iscsi neutron-server[101666]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'code': 200} Nov 08 04:22:26.648003 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4967c968-6cca-4a6c-b2d7-4ecd3b52edae req-5f13fd09-78e2-4576-8817-f8be9100092a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482130 Nov 08 04:22:26.686027 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8785436140180', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8785435675531', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8785435675549'] for port, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:26.733236 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Pushing event updated for resources: {'Port': ['ID=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,revision_number=6']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:22:27.765596 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf0ede7-7876-475d-95f1-ca7c097f9b1a req-bb873ebf-bc0e-4419-901b-bc684259a3df tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:27.767058 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0bf0ede7-7876-475d-95f1-ca7c097f9b1a req-bb873ebf-bc0e-4419-901b-bc684259a3df tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0468495 Nov 08 04:22:27.816162 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0bf0ede7-7876-475d-95f1-ca7c097f9b1a req-3f67a5de-4b13-4230-8eb3-f7dff8a2398f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433576 Nov 08 04:22:27.960565 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:22:28.926589 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c2f308-9fd8-4eb4-9a58-4d48fabc7551 req-1be10dc7-67d9-40d2-ad7d-119abef86530 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:28.928046 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91c2f308-9fd8-4eb4-9a58-4d48fabc7551 req-1be10dc7-67d9-40d2-ad7d-119abef86530 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0461290 Nov 08 04:22:28.977607 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91c2f308-9fd8-4eb4-9a58-4d48fabc7551 req-57a03043-752a-4b8c-91d2-83eb37a357f8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438528 Nov 08 04:22:29.678119 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-b7ef3a8f-98f3-4ed7-ae4d-107e617fdcc8 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0380297 Nov 08 04:22:29.773818 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-a0e80d2c-c984-4c9f-83ec-1aeb60404736 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:29.775281 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-a0e80d2c-c984-4c9f-83ec-1aeb60404736 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0386796 Nov 08 04:22:29.882397 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-42f49177-2e41-40c5-8814-c163cd101a75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:29.883958 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-42f49177-2e41-40c5-8814-c163cd101a75 service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0876772 Nov 08 04:22:29.947240 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-979ad8dc-4274-40b6-a904-faaaf0da15a3 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0563028 Nov 08 04:22:29.995241 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-5397ae81-aacb-40b3-ae15-7a77a08fb902 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:29.996619 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-5397ae81-aacb-40b3-ae15-7a77a08fb902 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0421700 Nov 08 04:22:30.044838 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-b7d99c21-b386-44cc-b80e-6873631f0460 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:30.046333 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-b7d99c21-b386-44cc-b80e-6873631f0460 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0432298 Nov 08 04:22:30.146356 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c853239c-6880-47e4-9e30-71cd5d31974d req-ff35812b-3078-4635-8ea8-4e58d05589f0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:30.147738 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c853239c-6880-47e4-9e30-71cd5d31974d req-ff35812b-3078-4635-8ea8-4e58d05589f0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.1005206 Nov 08 04:22:30.179654 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-8a655a2f-0c2e-4803-a06c-8d73fccade36 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1244621 Nov 08 04:22:30.229935 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c853239c-6880-47e4-9e30-71cd5d31974d req-cee79873-cd46-4cd4-89a1-269d182e6a2e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0753403 Nov 08 04:22:30.288645 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d08d280e-68cd-4971-848e-06c1b67e5632 req-2b0fa301-d71a-406a-8efa-a42c14b7a8a6 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0984497 Nov 08 04:22:31.341895 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e9c440-2189-4f80-824a-d05f5ada8695 req-f118832c-7f29-4ea9-9d1f-db537057c9b7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:31.343410 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e1e9c440-2189-4f80-824a-d05f5ada8695 req-f118832c-7f29-4ea9-9d1f-db537057c9b7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0476389 Nov 08 04:22:31.391854 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e1e9c440-2189-4f80-824a-d05f5ada8695 req-84acdb32-11ed-46ef-85d7-cd76a7f0fc7a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426624 Nov 08 04:22:32.506284 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57c1833-3a23-44a2-a49c-4f1d3e5c0f77 req-0b70cb60-34cc-4c87-a810-051e894b6fe0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:32.507780 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f57c1833-3a23-44a2-a49c-4f1d3e5c0f77 req-0b70cb60-34cc-4c87-a810-051e894b6fe0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0487680 Nov 08 04:22:32.561395 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f57c1833-3a23-44a2-a49c-4f1d3e5c0f77 req-1a45603d-8936-4eea-bd8c-0f7727df95ad tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441799 Nov 08 04:22:33.676052 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb65b9a6-9cbb-43bb-b046-ebe31028429e req-3ea21ebd-46f8-4895-9ece-66c5c148ae8e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:33.677486 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb65b9a6-9cbb-43bb-b046-ebe31028429e req-3ea21ebd-46f8-4895-9ece-66c5c148ae8e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0509312 Nov 08 04:22:33.725149 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb65b9a6-9cbb-43bb-b046-ebe31028429e req-b6e5d396-eb15-411e-9d41-c1bfed50c6ba tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417628 Nov 08 04:22:34.836406 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61594363-5631-4da2-bf67-90910da6cb6f req-b62b6922-084d-494c-aa70-ae9d901264f3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:34.837847 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-61594363-5631-4da2-bf67-90910da6cb6f req-b62b6922-084d-494c-aa70-ae9d901264f3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0478115 Nov 08 04:22:34.885631 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-61594363-5631-4da2-bf67-90910da6cb6f req-c09cd560-8df2-43b3-bf04-a72d84fa7df5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418851 Nov 08 04:22:35.998609 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9783ef-6626-4e74-9228-9d935ddce126 req-56417e2e-b7f6-4e25-b12f-fa4b9fda84cf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:36.000096 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9f9783ef-6626-4e74-9228-9d935ddce126 req-56417e2e-b7f6-4e25-b12f-fa4b9fda84cf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0490654 Nov 08 04:22:36.052108 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9f9783ef-6626-4e74-9228-9d935ddce126 req-33d754b9-47fe-4e3a-a991-c4be06014c12 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461271 Nov 08 04:22:37.163443 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b869d38e-ffeb-4762-be29-41e68e6c3a3e req-4eac5745-95b6-446a-a9ae-82f3203fd2db tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:37.165647 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b869d38e-ffeb-4762-be29-41e68e6c3a3e req-4eac5745-95b6-446a-a9ae-82f3203fd2db tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0480738 Nov 08 04:22:37.212994 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b869d38e-ffeb-4762-be29-41e68e6c3a3e req-0dd032b8-4fcd-40b2-b26f-8a912a71d17c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415802 Nov 08 04:22:38.327457 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-311d0607-e288-46c8-9e19-eadd2fe2b9ae req-f633ae09-91c5-4646-a77f-36a4aafde238 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:38.328900 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-311d0607-e288-46c8-9e19-eadd2fe2b9ae req-f633ae09-91c5-4646-a77f-36a4aafde238 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0473437 Nov 08 04:22:38.377127 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-311d0607-e288-46c8-9e19-eadd2fe2b9ae req-bb8c48d2-9c27-41aa-86ba-ab5997e540cd tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423818 Nov 08 04:22:39.492903 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c461d4f0-ca06-4b05-895d-2e5f768c193d req-02197a64-7ba8-42a1-bd09-61bdc55efce6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:39.494338 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c461d4f0-ca06-4b05-895d-2e5f768c193d req-02197a64-7ba8-42a1-bd09-61bdc55efce6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0521250 Nov 08 04:22:39.541640 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c461d4f0-ca06-4b05-895d-2e5f768c193d req-53c9f78a-ed1b-4275-ad52-e2885c466b53 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407813 Nov 08 04:22:40.658553 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f78902b-9cbc-46be-a9e6-84c3ec917384 req-dde2c7f1-f694-4df6-8b12-b218bdebcfb5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:40.659993 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f78902b-9cbc-46be-a9e6-84c3ec917384 req-dde2c7f1-f694-4df6-8b12-b218bdebcfb5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0476260 Nov 08 04:22:40.707588 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f78902b-9cbc-46be-a9e6-84c3ec917384 req-c7e34e67-5d97-4102-8fc5-177493acc182 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417540 Nov 08 04:22:41.823351 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef398325-6b4e-4656-951d-755ee62f327b req-e5e1279f-55e1-498c-85ef-63ec93bfe4f4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:41.825297 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ef398325-6b4e-4656-951d-755ee62f327b req-e5e1279f-55e1-498c-85ef-63ec93bfe4f4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0512197 Nov 08 04:22:41.873577 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ef398325-6b4e-4656-951d-755ee62f327b req-956f62b6-6005-44d4-8d15-632d5a14e690 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424192 Nov 08 04:22:42.634630 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f4c59ed5-c8b1-4b3f-ae25-c3d1428f74b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:42.993019 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-987f86ee-a65e-4b70-96d7-767afd1607bd req-c49dfe6f-ba96-4a01-bea3-fd7ba27c8f62 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:42.994527 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-987f86ee-a65e-4b70-96d7-767afd1607bd req-c49dfe6f-ba96-4a01-bea3-fd7ba27c8f62 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0534964 Nov 08 04:22:43.042238 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-987f86ee-a65e-4b70-96d7-767afd1607bd req-2722d138-669c-4f3c-a760-6839dce10e79 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417874 Nov 08 04:22:44.153094 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d02bbc-4ade-4fd4-a42d-6caa4a340297 req-9bba49ce-f323-4899-ab9a-cd69ed7b814d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:44.155335 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-22d02bbc-4ade-4fd4-a42d-6caa4a340297 req-9bba49ce-f323-4899-ab9a-cd69ed7b814d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0482237 Nov 08 04:22:44.207836 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-22d02bbc-4ade-4fd4-a42d-6caa4a340297 req-a0481e57-284d-4d3e-a759-52daf112dc96 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462115 Nov 08 04:22:45.143012 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-012ccbb4-b708-4fdf-a9c7-4c764b1c3ac9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:45.319154 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8185b8c1-00d8-49db-afcf-1f8cbe3c73f9 req-cf34a18e-ff0d-4dcb-855c-a4a65ee780c2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:45.320624 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8185b8c1-00d8-49db-afcf-1f8cbe3c73f9 req-cf34a18e-ff0d-4dcb-855c-a4a65ee780c2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0482976 Nov 08 04:22:45.368425 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8185b8c1-00d8-49db-afcf-1f8cbe3c73f9 req-de3f9951-cc25-4020-82bb-1c6f88c5604a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420125 Nov 08 04:22:45.993829 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:46.479289 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d8831ae-97d7-48a9-b040-ea76127e8b0c req-0e519330-4bbd-43ee-a312-c09cad933366 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:46.480807 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d8831ae-97d7-48a9-b040-ea76127e8b0c req-0e519330-4bbd-43ee-a312-c09cad933366 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0478580 Nov 08 04:22:46.529182 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d8831ae-97d7-48a9-b040-ea76127e8b0c req-27639001-0aa6-42a2-9a8d-a4261fa6aab0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424373 Nov 08 04:22:47.646803 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933adb12-4640-4184-9a73-24bdac60389e req-47dd96d9-4f1e-4e87-998b-318efed1b3c6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:47.648242 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-933adb12-4640-4184-9a73-24bdac60389e req-47dd96d9-4f1e-4e87-998b-318efed1b3c6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0509470 Nov 08 04:22:47.675293 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:47.695525 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-933adb12-4640-4184-9a73-24bdac60389e req-3d986dc3-846f-4f19-a745-dc2f13ced0ad tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407081 Nov 08 04:22:48.377806 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:48.809488 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df08aeca-2166-4f49-959c-59eafb736b7c req-6a9f7710-2c3b-40f4-aeba-d956b17f9698 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:48.812036 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df08aeca-2166-4f49-959c-59eafb736b7c req-6a9f7710-2c3b-40f4-aeba-d956b17f9698 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0483339 Nov 08 04:22:48.862952 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df08aeca-2166-4f49-959c-59eafb736b7c req-a677e3a1-5e85-423b-aa57-71333fbeb7ab tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453515 Nov 08 04:22:49.973672 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7437088a-559f-4076-b7ac-be68a0d3f010 req-d34e255d-6714-4482-b1c4-e7324169147e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:49.975161 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7437088a-559f-4076-b7ac-be68a0d3f010 req-d34e255d-6714-4482-b1c4-e7324169147e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0474360 Nov 08 04:22:50.026268 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7437088a-559f-4076-b7ac-be68a0d3f010 req-b9adacea-621e-44ae-b2e3-8ad7d89e2a50 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442729 Nov 08 04:22:51.138298 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ded0c73f-1ad0-4f5c-b1c7-466a3865c3ef req-032fe60b-4c0b-416d-8098-a9a61dc0a104 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:51.139764 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ded0c73f-1ad0-4f5c-b1c7-466a3865c3ef req-032fe60b-4c0b-416d-8098-a9a61dc0a104 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0480552 Nov 08 04:22:51.186998 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ded0c73f-1ad0-4f5c-b1c7-466a3865c3ef req-13bb536f-8c67-4574-a1a2-3908437563bc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414841 Nov 08 04:22:52.296939 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da819f0a-e392-4974-ac20-759811c76d2e req-95aa506a-df17-4e86-97b7-670d40315b19 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:52.298370 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-da819f0a-e392-4974-ac20-759811c76d2e req-95aa506a-df17-4e86-97b7-670d40315b19 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0472732 Nov 08 04:22:52.347385 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-da819f0a-e392-4974-ac20-759811c76d2e req-a7f73adb-465b-4b49-bf59-2afe4286372a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419643 Nov 08 04:22:53.462230 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb086f2e-4928-41f7-a33c-a4bbdef41020 req-87ab0210-efe8-47a8-928d-9a29a60cd5c9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:53.463657 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb086f2e-4928-41f7-a33c-a4bbdef41020 req-87ab0210-efe8-47a8-928d-9a29a60cd5c9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0502067 Nov 08 04:22:53.510548 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb086f2e-4928-41f7-a33c-a4bbdef41020 req-be66d8ba-ec25-4ea5-88ff-7d4d944dcf62 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409672 Nov 08 04:22:54.308840 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:22:54.623138 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5aeabe0-4edc-4d3a-bd61-f380ea1446d7 req-f4f05c20-27f8-46e3-a09a-e614d84ee3be tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:54.624576 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5aeabe0-4edc-4d3a-bd61-f380ea1446d7 req-f4f05c20-27f8-46e3-a09a-e614d84ee3be tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0480423 Nov 08 04:22:54.671973 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5aeabe0-4edc-4d3a-bd61-f380ea1446d7 req-69bc83f7-a339-4e3c-b944-b3b0aa4eba99 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415051 Nov 08 04:22:55.787082 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31323bb4-33d6-4493-b4c1-c7aadfd27cab req-809d40ff-cad4-4e46-8b81-15aa3bae571b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:55.788528 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31323bb4-33d6-4493-b4c1-c7aadfd27cab req-809d40ff-cad4-4e46-8b81-15aa3bae571b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0507224 Nov 08 04:22:55.837333 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31323bb4-33d6-4493-b4c1-c7aadfd27cab req-04a9e5bf-9efe-4066-a44e-c6cb92d8e989 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423307 Nov 08 04:22:56.949992 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-549f93e2-64ce-4c4f-a968-f038884b8fb3 req-b7c29569-ffc5-4d86-bcee-586218a4559d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:56.951494 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-549f93e2-64ce-4c4f-a968-f038884b8fb3 req-b7c29569-ffc5-4d86-bcee-586218a4559d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0475743 Nov 08 04:22:56.999574 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-549f93e2-64ce-4c4f-a968-f038884b8fb3 req-f08ad5e0-2ec7-4f54-b1c1-0bdff334c12c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422850 Nov 08 04:22:58.111004 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8554cc0a-01a7-492f-a1d1-0c40d7be7ae4 req-fb2ff89b-622a-4b28-a645-c2a6224d8910 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:58.112425 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8554cc0a-01a7-492f-a1d1-0c40d7be7ae4 req-fb2ff89b-622a-4b28-a645-c2a6224d8910 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0479088 Nov 08 04:22:58.162378 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8554cc0a-01a7-492f-a1d1-0c40d7be7ae4 req-17e4cabd-3419-4fcc-8fe0-86900824e89f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441282 Nov 08 04:22:59.272911 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757b5d1b-bb02-44b2-b42a-af6ebbe21ab3 req-0472ffae-ec07-4071-9633-cc4c973f789d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:22:59.274364 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-757b5d1b-bb02-44b2-b42a-af6ebbe21ab3 req-0472ffae-ec07-4071-9633-cc4c973f789d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0472283 Nov 08 04:22:59.324331 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-757b5d1b-bb02-44b2-b42a-af6ebbe21ab3 req-d5706b3a-58ee-4be7-aa9d-9f6cf8681f32 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434394 Nov 08 04:23:00.435652 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c3e898-1c36-42b0-8bf3-54b6ad052ff6 req-32decba1-0432-4cbd-841c-b83b64580081 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:00.437062 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d2c3e898-1c36-42b0-8bf3-54b6ad052ff6 req-32decba1-0432-4cbd-841c-b83b64580081 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0467715 Nov 08 04:23:00.484246 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d2c3e898-1c36-42b0-8bf3-54b6ad052ff6 req-d82b929b-3262-4365-a4ce-f92e89f048b4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414343 Nov 08 04:23:01.600486 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-254b5421-50f2-4a30-b301-43c98082ef76 req-292abc10-ed5f-4124-b131-92824f92e29d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:01.601960 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-254b5421-50f2-4a30-b301-43c98082ef76 req-292abc10-ed5f-4124-b131-92824f92e29d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0522518 Nov 08 04:23:01.650345 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-254b5421-50f2-4a30-b301-43c98082ef76 req-462fb578-81ea-463c-a53d-4054873a1239 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422494 Nov 08 04:23:02.762502 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-866b5960-202b-40ec-a24e-e38fd0220003 req-15ab7106-7655-415c-8329-935063e126e5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:02.763999 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-866b5960-202b-40ec-a24e-e38fd0220003 req-15ab7106-7655-415c-8329-935063e126e5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0479884 Nov 08 04:23:02.816982 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-866b5960-202b-40ec-a24e-e38fd0220003 req-28e35ccb-5a00-438f-879f-238067684730 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471375 Nov 08 04:23:03.930122 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-709a380c-91e8-43e6-aa26-e1bc076c7911 req-e2db7a45-2e4b-4239-bdb9-c6bc09e5ca40 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:03.931645 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-709a380c-91e8-43e6-aa26-e1bc076c7911 req-e2db7a45-2e4b-4239-bdb9-c6bc09e5ca40 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0475376 Nov 08 04:23:03.987263 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-709a380c-91e8-43e6-aa26-e1bc076c7911 req-8a7e95d5-eda4-4489-8558-3bdb18e483d1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497055 Nov 08 04:23:04.960062 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:23:05.100534 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9381ac0-6846-451c-b3a4-ad185f6266bf req-8f67cf5c-dd8f-41a1-8bfb-f320f0779578 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:05.102008 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e9381ac0-6846-451c-b3a4-ad185f6266bf req-8f67cf5c-dd8f-41a1-8bfb-f320f0779578 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0497735 Nov 08 04:23:05.154222 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e9381ac0-6846-451c-b3a4-ad185f6266bf req-c3a28be3-df0f-4601-83c3-c1d66507d3c1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452259 Nov 08 04:23:06.266005 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531e34f2-4235-4477-9449-31e089656d5e req-186de323-f770-4ce1-9dcc-f05afb5b2167 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:06.267495 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-531e34f2-4235-4477-9449-31e089656d5e req-186de323-f770-4ce1-9dcc-f05afb5b2167 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0477176 Nov 08 04:23:06.314979 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-531e34f2-4235-4477-9449-31e089656d5e req-1f863234-f1be-4b60-9d68-d5f08ef94479 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416074 Nov 08 04:23:07.429031 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3acc04ce-1dea-401f-8384-9cf3bacf744d req-5bc4d765-ff3d-40b7-bb7d-7451b3239d87 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:07.430449 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3acc04ce-1dea-401f-8384-9cf3bacf744d req-5bc4d765-ff3d-40b7-bb7d-7451b3239d87 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0504572 Nov 08 04:23:07.477193 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3acc04ce-1dea-401f-8384-9cf3bacf744d req-e0376a3b-28d7-4ddd-b49e-94c77197d323 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403049 Nov 08 04:23:08.589666 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b74440f-0cd4-4581-ad67-aaff638bd3f7 req-d4eda129-29a6-4a58-975a-cde3d8a31aa3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:08.591168 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b74440f-0cd4-4581-ad67-aaff638bd3f7 req-d4eda129-29a6-4a58-975a-cde3d8a31aa3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0472949 Nov 08 04:23:08.640970 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b74440f-0cd4-4581-ad67-aaff638bd3f7 req-12aae6c8-b777-4bd9-9bb8-27aa7f9bd8bc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438800 Nov 08 04:23:09.750106 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-71a21838-77f5-461d-8305-9895a9bc18a7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:09.751545 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-71a21838-77f5-461d-8305-9895a9bc18a7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0758305 Nov 08 04:23:09.768412 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfed33f0-a99c-4bea-b757-2ebe9178871a req-107e0edc-6e4d-4e5d-b72e-351231ead64e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:09.769764 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cfed33f0-a99c-4bea-b757-2ebe9178871a req-107e0edc-6e4d-4e5d-b72e-351231ead64e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 943 time: 0.0620072 Nov 08 04:23:09.863773 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cfed33f0-a99c-4bea-b757-2ebe9178871a req-eae683f6-8154-473f-869c-f8f3ec81b11d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0873010 Nov 08 04:23:09.882563 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Deleting port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:23:09.882901 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:09.970097 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] For port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:23:09.970454 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:09.983223 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Calling delete_port for 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:23:10.171488 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:10.200541 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event deleted for resources: {'Port': ['ID=0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:23:10.212081 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.212437 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.212775 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.213106 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.213435 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.213765 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.214097 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.214422 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.214773 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.215095 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.215421 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.215751 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:23:10.248892 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] No DVR routers for this DVR port 0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:23:10.251324 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:10.254582 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f7806457-6986-4862-a2ac-9c9a29bdc5be req-ca937f0a-7155-46b9-a324-771d192cbd63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "DELETE /v2.0/ports/0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0 HTTP/1.1" status: 204 len: 173 time: 0.4942417 Nov 08 04:23:10.255012 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'name': 'network-vif-deleted', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:23:10.257256 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36ce2b1d-ff33-4030-aea1-9a4be67995c8" -d '{"events": [{"server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "name": "network-vif-deleted", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:23:10.296307 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:23:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eaa71ac8-00b3-48c4-b722-13196e0b1b86 x-openstack-request-id: req-eaa71ac8-00b3-48c4-b722-13196e0b1b86 {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:23:10.296670 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ffed274-5857-44b0-acf4-2dd126fa410f", "name": "network-vif-deleted", "tag": "0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:23:10.296931 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-eaa71ac8-00b3-48c4-b722-13196e0b1b86 {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:23:10.297334 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ffed274-5857-44b0-acf4-2dd126fa410f', 'name': 'network-vif-deleted', 'tag': '0fa8a1e8-aeb5-4fef-84ea-59cd9f4d35a0', 'status': 'completed', 'code': 200} Nov 08 04:23:10.959134 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-744419c8-ed90-4d8c-a057-5d9f7951806e req-ff6a5720-e63d-471b-972e-a7c347eed811 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0289428 Nov 08 04:23:12.051942 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-76af756a-0b2e-49c7-8ff1-5260126fe3f0 req-bc182a29-eed5-4804-aa57-6bb11117aa10 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258894 Nov 08 04:23:12.645889 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-17d0c6ac-78e1-4fd5-a023-d5373c14ce5a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:13.143332 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ac9fffe-affb-4789-b0c2-c1b64e24253e req-170bae9e-bda8-48bf-8da0-fb3425bb17e8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0265083 Nov 08 04:23:14.233889 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-983673ec-122d-41e1-a89c-1d337961c2c7 req-2527de14-1cc3-4e40-89be-a0170304e30c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254266 Nov 08 04:23:15.159655 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3e82e9b8-5397-404d-b115-7759a30bb921 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:15.327434 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a86a8aab-5a87-4960-86c1-c849a07b966b req-9cfcb5d4-2682-4a62-94e0-f4069bac4528 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256994 Nov 08 04:23:16.011501 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:16.416659 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-82436805-6ca4-4f78-bd2e-7306ed722009 req-47ce33e8-c369-4380-bb35-d506560be0ea tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253727 Nov 08 04:23:17.510229 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a118f31b-1e2b-47f2-bb85-bb0a424e7c15 req-81a827e7-6265-45f5-9baf-ec7fcb5c2f64 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0280232 Nov 08 04:23:17.644715 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:18.422900 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:18.610400 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fe7e8958-050f-40c2-84ed-60ecff7899b9 req-e5ece771-2fb2-4db3-9ce1-22594b3b7528 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0355148 Nov 08 04:23:19.703108 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-41fedb14-dcce-40d4-8860-ef76b5d59cbb req-a745a0d4-96a2-483a-84c5-f0b5eac04aac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247102 Nov 08 04:23:20.794779 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-925ce9fe-3b2e-4367-9081-1072b4bd6be1 req-e62b54d2-6a9d-4437-98d1-5963bb1813cf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253608 Nov 08 04:23:21.884615 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-212d93d5-d6d2-4691-a70a-24c9668b68cd req-b8d8904d-96c9-48e9-baeb-c692cc41a638 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249012 Nov 08 04:23:22.974707 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-78ab8439-05e1-4f55-9f16-e6371617a5b0 req-e92e3c68-b197-4503-b955-26cb6af5511f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256701 Nov 08 04:23:24.068133 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dce4442f-d250-470c-8c44-14bfb2d482ed req-c6b194e4-31a9-45d5-b075-51310614e61b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0286498 Nov 08 04:23:24.309934 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:25.160561 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ccb993e5-7cea-475e-9ff4-eba53ef52529 req-46906383-65f4-4db6-b6a1-e060ee5c46a1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257807 Nov 08 04:23:26.251983 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6bebc58e-c53c-4fa5-a7ac-d918d2873ece req-0fb1d3a4-264a-4599-a14b-16e191265d09 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259340 Nov 08 04:23:27.341683 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cadc1480-4c94-4a14-acb0-adfad699a3ba req-055516ce-bbd0-4056-b93a-5e25e4e65e27 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249910 Nov 08 04:23:28.431532 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2244b681-b42f-4c4a-8621-9288e0bba258 req-8f8580a4-b04d-4078-aba5-a397c4905557 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253665 Nov 08 04:23:29.521438 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f357f674-06ea-45d8-bb16-d66bfc52730d req-8354d2db-b170-4b0b-a4d3-7a79e91c11c7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254741 Nov 08 04:23:30.618940 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5a26ad6-9d30-4dc9-b2ec-1212ac7dec32 req-ce35f7d9-f1ce-4899-9224-5ba54df72669 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0288074 Nov 08 04:23:31.654578 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-f6fbbef6-c9bc-4faf-baa4-107f120dd5af service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0380807 Nov 08 04:23:31.729531 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f11d1ebc-4f5b-495e-923b-09f05d37e43b req-a2b670fd-c384-48f0-aa76-d70bec3339b7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0439565 Nov 08 04:23:31.745165 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-6dd23b98-bf6a-4700-9d15-21d02684949f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:31.746633 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-6dd23b98-bf6a-4700-9d15-21d02684949f service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 1098 time: 0.0525565 Nov 08 04:23:31.848518 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-0562eb7c-c03d-4601-9d58-7950d7f3a61f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:31.849856 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-0562eb7c-c03d-4601-9d58-7950d7f3a61f service neutron] 10.222.0.16 "GET /v2.0/networks?id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 200 len: 914 time: 0.0844183 Nov 08 04:23:31.889580 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-98524771-5bc0-42ff-ba58-405f2991718c service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3 HTTP/1.1" status: 200 len: 217 time: 0.0324926 Nov 08 04:23:31.938726 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-fdb1d3fd-0e36-47b5-af73-d195f31f3c92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:23:31.940088 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-fdb1d3fd-0e36-47b5-af73-d195f31f3c92 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b7476cdf-e453-4db0-a095-7baf9278351d HTTP/1.1" status: 200 len: 853 time: 0.0441778 Nov 08 04:23:31.970748 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-8bfc8c5b-1fc4-4870-bfc3-86be3ab7f249 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0236082 Nov 08 04:23:32.066555 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-a8c14590-2af0-4465-91b6-bd0c16ab55b1 service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879538 Nov 08 04:23:32.156856 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-829733a1-5bbc-44df-9afa-56d8330e9d3a req-8a9ead96-5007-424e-a522-613a1d2c0d41 service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827205 Nov 08 04:23:32.820153 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eac73c7b-bad7-46ab-9e15-b1a7464ebd22 req-462cf06d-2433-45a4-b71c-6409b19534f6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258298 Nov 08 04:23:33.910679 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e2824042-f1ac-4b0f-98f9-8cc4a3448742 req-d2af97e2-d1fa-4cb4-8281-b726c9b94263 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256491 Nov 08 04:23:35.005339 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a35360d4-6cad-4204-a52c-4db598f17e4a req-ea147b8d-869c-4e1d-9f02-45e8062723fb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0302536 Nov 08 04:23:36.099913 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1c1203d9-9140-44a3-baca-496389135f41 req-63a7d2a4-83f2-43eb-996c-2eab8156ccb7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0289731 Nov 08 04:23:37.190974 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a6256fa6-cabf-44d9-bf7e-67894846d069 req-5eab5230-eaca-4a30-bce6-d6c1584bcdea tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260057 Nov 08 04:23:38.282294 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ef899a9f-35a3-4abc-837f-90e4f099df5f req-101748a8-5a40-4fa6-9991-8da33163ff68 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260141 Nov 08 04:23:39.373372 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7494e2a4-80a9-4fa3-84ef-3b56647e338c req-6a93e838-c2cb-490c-a1fc-ae688612c3fd tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0262845 Nov 08 04:23:40.464126 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00907c28-cd83-4e1b-891a-9923775090e3 req-0ca82423-8e75-4ef4-afcc-f2eede79d2a3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258172 Nov 08 04:23:41.554785 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-16b4161a-6748-464b-b881-f7219a9d2baf req-3b891fe8-bb47-42e9-aec2-5d421cbaa2b5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254047 Nov 08 04:23:41.958810 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:23:42.656891 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2d8aa6ec-7fba-405a-ac40-b47665075a67 req-99b1fdea-2b5d-4fc3-a2d4-ba51444912b9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0283997 Nov 08 04:23:42.662881 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9a7bd12e-671e-41fd-b43c-c7150441e750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:43.747284 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c94e56c4-03d0-4d83-8e9d-6a592dbb8022 req-49f6a005-2507-4f25-b783-a851a13ef102 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257783 Nov 08 04:23:44.836526 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fd5d57e3-2503-4c66-8940-41c1a9540869 req-a350488e-0a5d-45f4-95ee-932b3a933529 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252202 Nov 08 04:23:45.169266 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9aed6e17-92e7-45b4-a598-6b0e51925ce1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:45.927973 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-78509032-ee32-41d4-80f2-a98e9f9492af req-2ef44bf6-6935-49e0-8e02-40e369e61b55 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252213 Nov 08 04:23:45.982414 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:47.019517 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9183030f-f26f-45ba-a6e5-3f1b1ef5ed98 req-2d0adbf8-747d-4fc6-9a21-c79980b8d17a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257595 Nov 08 04:23:47.634597 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:48.110847 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b3b9d1a3-2d61-42d4-b34b-bcac349a053f req-3fcc7ba8-0f95-48e6-bc43-fa25277aacec tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0264111 Nov 08 04:23:48.409765 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:49.206235 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6b8e0214-45c5-42ff-b318-74ae07427a73 req-2b886c26-1916-4032-8147-6597f3aad04a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0293620 Nov 08 04:23:50.299281 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f2ce2f6c-4476-46dc-8c2c-1b5bd98a620a req-7118f3f2-3420-4159-86bd-8f75dd3c1934 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0248680 Nov 08 04:23:51.389899 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-94c8ce5b-5e00-4b9e-a274-2773306e578a req-70d4af5c-cd91-420f-9907-31ec0be8ec98 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253243 Nov 08 04:23:52.480316 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2d95b4aa-3220-49b7-b1e3-7d543aced547 req-f51f3c0b-5c6d-422f-b65b-2de1aec5e710 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249515 Nov 08 04:23:53.571282 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8ac06037-1194-48ed-8e51-50e17ac97f89 req-5c26e2c6-495c-4c4f-9fd0-4fcac67d316a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253432 Nov 08 04:23:54.375282 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:23:54.662557 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0b7c878a-bce2-41a7-973d-74caa02060ce req-9f274a40-45fa-43ec-9334-db4e1a2117cf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249338 Nov 08 04:23:55.756525 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4d4ad0ce-17e1-4336-b121-5d3c200d20c1 req-e04113ea-44b6-499b-a603-897ff8db8580 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0289629 Nov 08 04:23:56.847736 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1a0223cc-5612-4c15-8abc-201fa1cfc197 req-59a582f2-b20a-4dfa-8648-0899f1e5ade1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0261252 Nov 08 04:23:57.941998 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d42e8720-fec3-4d3a-a1fb-93a638b4ab2f req-13f2a412-a2fd-4bc5-b9da-d1b7ccff44e7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0281229 Nov 08 04:23:59.033140 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dcb6a595-af53-4fa3-b602-d2dab65c091e req-bdbdd8e4-984f-4241-88d2-4e173d4fc988 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0250261 Nov 08 04:24:00.124005 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bc1c4e30-0f75-4191-a312-e0893d745b1b req-47cf1e45-8f51-40ad-bfd9-5b37c27a4b25 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0261002 Nov 08 04:24:01.213110 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a7aa2be1-e6e8-4d81-a468-949feeeaa099 req-8a343bfd-8cf9-4962-881f-00b8d2b6a303 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0246136 Nov 08 04:24:02.306436 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a1c28c74-9196-440c-939e-0f605d941494 req-2b599b7d-4dee-479c-8fb2-98d711c8da50 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0277500 Nov 08 04:24:03.396732 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1c7e8cd4-109a-463f-8be0-5984a1af44b1 req-7ce4f443-a069-4130-bfbd-014131ddf4f8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252409 Nov 08 04:24:04.488343 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d31cedff-8701-4e96-8881-44c9d15b2ba9 req-214ad351-b588-485e-a0de-808f45dc5495 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249231 Nov 08 04:24:05.584351 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e176f192-7a90-406e-9c14-7f22d054dc2f req-0b8af679-d4ff-4ce5-badb-b31f6fb39905 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253298 Nov 08 04:24:06.675891 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aa1db3a6-be6f-4a60-bcd9-b2e60fd4c03e req-cabd033a-a649-4802-b600-7338f2633284 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0248663 Nov 08 04:24:07.766982 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ae3af379-5bab-4acf-8b64-4dd48a41ae55 req-49514bb9-72ba-417e-b55d-df0b1d278722 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256145 Nov 08 04:24:08.860400 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b9061144-1693-4bcb-b28c-3cec1a7b6fe3 req-b8f18666-2523-4bf7-b9c6-85eda18de8b4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0284882 Nov 08 04:24:09.957088 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f5a8ad3-26a2-440b-acbc-d625e01f2a39 req-0ef7e03b-50d8-4d6f-835d-5b8aebde800a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259845 Nov 08 04:24:11.051303 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b82f36dd-2c10-47f9-8186-52e03e0d2c96 req-a633afc5-38a1-45c5-aae6-5e28b188238c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0263581 Nov 08 04:24:12.144210 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-efe97f29-2379-4e74-a9c3-1b6c465120bd req-4a44dfab-af91-40e5-980e-4c8be927d84f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0262659 Nov 08 04:24:12.679201 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c9738b3c-5199-49e0-ad4e-a97b4aeae779 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:13.233316 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a5534ded-212b-4308-ae99-6039d8208ada req-432f7a77-53c2-48b5-9827-40e6db1e210f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256603 Nov 08 04:24:14.322131 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c9d85d57-0a63-46cc-ac7f-3dbb50a70776 req-432fc043-e6b2-4b26-b2fe-8eadb5b9b72b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252819 Nov 08 04:24:15.151704 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e1b38383-0837-4ee3-a437-d8c349fbab1e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:15.415157 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aa4c2323-46c4-4d72-a91d-a03e15ada668 req-b7db0001-3093-4236-a9ad-ff6c8eef9656 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0280945 Nov 08 04:24:15.997723 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:16.506526 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f658a8d-e693-49d1-b3f9-6852c730622b req-284b816c-4efc-4777-87ee-3cd1d3a892a4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249851 Nov 08 04:24:17.597723 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-367530eb-1efe-4195-9f21-d27632bb1b68 req-20b3ed09-c312-4fb7-a3b4-dcfc89ec5208 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0268905 Nov 08 04:24:17.620257 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:18.375942 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:18.689253 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ff9398ea-281a-4aca-b646-5de4098f0be1 req-c1f616fe-1779-4f66-ae78-b8c3bb0a0595 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254672 Nov 08 04:24:18.958124 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:24:19.780388 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-63609c14-417b-4f46-8eb4-045957651fd3 req-81d4f930-38ff-47a1-bc20-ff98d3916cfd tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258601 Nov 08 04:24:20.876215 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eaef047e-8ab1-4b1a-bad1-302709a09bdb req-0a853b5b-d3ad-466a-9b92-592f7d407583 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257523 Nov 08 04:24:21.969258 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d10e5685-5e80-4a7c-b51e-3ce30de8b466 req-c8259d7f-1c43-40f0-9006-2052adf6197b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0277734 Nov 08 04:24:23.060736 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-53036f81-c25b-43c6-89ed-ed1979ff865a req-5def859b-f338-4564-bd1e-5260b4cffeb0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0250483 Nov 08 04:24:24.152494 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bc399590-885b-4f88-8261-2076e1d5b45a req-dee00b14-ceed-4b34-9a6b-bd7e3465991f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256758 Nov 08 04:24:24.346108 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:25.244793 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5589b37b-ab30-4815-82bb-2dc086372571 req-3df140cb-a200-4c1f-a4b6-62bb0805a883 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258117 Nov 08 04:24:26.335065 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31f13719-7a54-41cb-9bee-072c043a24d8 req-f28994fd-459d-4b91-bc9a-9270ee7eb0cb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247560 Nov 08 04:24:27.425266 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-03742af5-3edf-41db-b27b-37e8b7f9e89c req-91de01de-34a6-4550-b12d-168c71f2f56e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253720 Nov 08 04:24:28.519115 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2e5bfe54-a1c7-4181-9d62-a44e1f2e6ea1 req-c7fdda84-64cd-4a37-b17e-7bca51f6f71e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0277288 Nov 08 04:24:29.611536 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f4da1af2-b052-42ad-a450-77978fda759b req-0ac0c1e8-c1c3-426d-97f0-a95f64323f82 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259643 Nov 08 04:24:30.701675 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9068f417-235f-45c0-a76a-3828ca8132cc req-d78267c9-fca7-44fa-b3c9-ca367ac85193 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257311 Nov 08 04:24:31.792165 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e61d9240-4f6c-4458-8528-27f3354df1bc req-20935a81-875b-4670-b47a-593007d4a4e9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258882 Nov 08 04:24:32.881889 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4bda4fb9-4efa-45c5-a655-a14ba3850b3e req-deb41e07-9696-4e28-821a-eaef2e84e3e2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252049 Nov 08 04:24:33.660584 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-7de6235a-5671-4ed7-8ed1-59bcd18a93b2 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0376339 Nov 08 04:24:33.757965 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-0ff4b124-1c90-4ca8-b575-2307790d9c91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:24:33.759433 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-0ff4b124-1c90-4ca8-b575-2307790d9c91 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0422289 Nov 08 04:24:33.860783 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-fefc12b1-c7f4-409d-8be6-9b01adedc27b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:24:33.862243 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-fefc12b1-c7f4-409d-8be6-9b01adedc27b service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0827675 Nov 08 04:24:33.929724 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-8117edc0-3e11-4ae7-b302-de1283bd5f8b service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0594804 Nov 08 04:24:33.989557 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ef19ef05-da98-4ede-8f3d-d89678869f0b req-7895c37d-9208-437d-8012-0d48a39598f7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0284708 Nov 08 04:24:33.999703 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-0beac1a7-6fff-45d7-8497-6fb88be60d84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:24:34.001090 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-0beac1a7-6fff-45d7-8497-6fb88be60d84 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0646369 Nov 08 04:24:34.046360 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-de5c8160-d771-4b39-b7d2-24b45769051f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:24:34.047830 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-de5c8160-d771-4b39-b7d2-24b45769051f service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0391905 Nov 08 04:24:34.140202 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-7109a4fa-1b0a-4982-8fa1-d9b464f3291a service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830939 Nov 08 04:24:34.231741 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-101c6494-9f42-4333-ab05-b1fdd47109f5 req-51071a1d-8a94-4e51-abe9-108ab6419365 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848899 Nov 08 04:24:35.079880 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a4700e19-649f-479a-ba54-78d16351e6b8 req-8991d7da-1974-400a-b7b4-042b97028a86 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256436 Nov 08 04:24:36.172084 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e0ec72d8-f7d7-4965-89d2-8c5a53087c2b req-44a1b3c9-e6a4-456f-9382-aee3f83b672a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252676 Nov 08 04:24:37.276292 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b7f636d-0696-4efe-946d-b20f08f059c3 req-86206633-b147-46af-ba4d-e4f1013e54da tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253391 Nov 08 04:24:38.367187 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-05ec939e-5d55-474c-861a-93b699345db1 req-14c20a69-0de3-47ae-aaca-0ef3d0e4bc91 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252821 Nov 08 04:24:39.457685 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-66862ad1-533f-409f-bdf9-933b7d376e9d req-6e83421b-8b6d-43b0-9746-5db4c36847b4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256934 Nov 08 04:24:40.816397 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-119bd888-df12-4956-bac0-e43bdddf68aa req-f56ab291-848b-49c4-ab3c-5a95647f56f7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.2929842 Nov 08 04:24:41.906896 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ce5f6182-700e-465e-9831-b97f70565305 req-889d691c-de37-4d88-bd4a-2cc7aef73af1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0248075 Nov 08 04:24:42.678562 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-ad5950c3-3c74-461b-bf91-f39c090dfeaf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:42.998120 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8c45aad8-172c-4201-8580-9b4a18073a64 req-9191e3aa-4f1d-4746-a7df-ed24bc17964c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258265 Nov 08 04:24:44.091415 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d6e77a8f-2fdd-412c-8a1c-9460481fb54c req-710c0447-6c90-4b85-9b78-85552499ee6d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0282185 Nov 08 04:24:45.187880 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5d68ecc2-7b06-4003-9a9a-309765db9c04 req-50a220c4-cdca-45ca-ad5f-40057a5ebd73 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0286331 Nov 08 04:24:45.192932 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9ff8fa75-427e-48e2-a9b3-f16d6c239b0d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:46.010074 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:46.279796 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7d876da4-e94a-4132-b367-b6d9be66d012 req-18389677-bf2f-4f18-8e8f-2d7fc3027fbb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0251713 Nov 08 04:24:47.369731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6c293008-0409-4a8d-859f-8fde0381b44e req-bb9acae3-6bbc-4802-a531-867a9f72717c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247262 Nov 08 04:24:47.661681 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:48.364181 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:48.461185 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4672703b-2f86-40b2-a4c1-294b169e884f req-7741ae6d-6559-4c4d-b053-85d10da89600 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256536 Nov 08 04:24:49.551246 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c9ab4ba0-1dfe-410b-8f7a-3d0c30e26f01 req-70e9a709-6c1d-48c1-be89-854a326d658f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247326 Nov 08 04:24:50.642268 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e3d53180-c357-4fee-9254-c29c4814b48a req-8328d23b-fc16-4476-9d1d-ece54b4f0109 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253305 Nov 08 04:24:51.743638 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-882457f6-a721-4da3-8a67-9d5d1d81a872 req-308b2c4a-3622-434d-9ce5-2485a4327618 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0345047 Nov 08 04:24:52.835042 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8df6472d-1bc3-48d4-bef2-e38676736374 req-092e4dae-b6a3-4dc0-85fc-e3674c711f7f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253398 Nov 08 04:24:53.925610 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0c66cf34-895e-4935-9d44-f4fa2dbe4695 req-2798310f-f289-4506-a971-11d55594df99 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0245926 Nov 08 04:24:54.347372 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:24:55.015635 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-22b41510-6052-488b-8e94-0c11fa848d47 req-8d6fdc71-5659-4b6f-9021-e9272cece81d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0251064 Nov 08 04:24:55.957817 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:24:56.106589 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aadadc3f-eff4-45eb-bfc6-0956ed86452e req-2f296b99-c554-4f14-9250-7790f73d1b26 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0262625 Nov 08 04:24:57.195479 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e78cac36-8d5f-4d15-8548-7a941d3f6381 req-8cadc814-0208-43d5-983e-1601c60dba54 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249448 Nov 08 04:24:58.291176 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-591ede01-e480-46ef-8c86-1a6eb0838266 req-cd4e46dd-5f13-4605-b7ef-c883b6e90251 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0277243 Nov 08 04:24:59.384509 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4b79d3cf-12f0-41a9-8db2-ce760f90fd96 req-20a87e46-4920-4832-96a4-6f5c937fd881 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253639 Nov 08 04:25:00.475434 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e20d71be-03d8-4717-9e56-7ddbaddb9b23 req-fad2a010-f71e-44c8-8299-44fa125b648c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257328 Nov 08 04:25:01.566944 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-56f5ff78-3725-4d8a-b245-70d053ccccd1 req-d48c064b-e44a-43c4-b06d-aa0f604c8a18 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258229 Nov 08 04:25:02.657498 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-692d5365-051c-4f9d-b709-d6f3b0f01bc2 req-9416e55f-08cc-46ac-b266-22e4c5095fd4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258820 Nov 08 04:25:03.748490 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-88e4f9ce-fb53-4110-9446-e42955ff8c01 req-cf8b6ad3-a914-4cd2-9dc1-7f148f82dc73 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256054 Nov 08 04:25:04.842549 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dda5896a-6eaf-4117-8059-638a22e2f92d req-6b871389-9da9-48a4-86b9-bff733de5dc4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0287983 Nov 08 04:25:05.936218 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b9d84f84-64cd-4233-bc76-a6b76ae4279d req-9017be4f-e33a-45a0-bb2f-99257175e46c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0264845 Nov 08 04:25:07.029610 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2e9ae153-6948-42ec-84e4-471d7aae5d47 req-fd043297-e398-4c8c-8296-b22c5f05ec74 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260468 Nov 08 04:25:08.119948 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f38dab04-adda-4b11-a446-9efe6393a4dc req-877f128c-c44b-46a4-b65e-be0668217e56 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249472 Nov 08 04:25:09.209859 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5722f38f-799e-4fe0-82ca-bae74e31bcb9 req-95d77c0f-7849-4be9-8bba-d505db6e887e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249693 Nov 08 04:25:10.300426 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea213053-5061-44c9-a8d0-c13c08301b9d req-a1f5bfce-b583-493e-bfd6-e1c4d765b3e8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256150 Nov 08 04:25:11.594011 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-16edb058-4864-4e75-aeda-d90d7d40e9f1 req-61040e40-9e32-4902-89f2-ad079f25aab8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0280328 Nov 08 04:25:12.649976 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d585dbcc-fb10-4781-a10b-8263a48c432c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:12.687492 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0d7fa8b7-2429-41fd-909b-7b870bbdba86 req-8a66c0d3-a5fa-47fb-99fb-30303829c5da tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259771 Nov 08 04:25:13.779219 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-deeb5826-f27f-4a7a-92d5-f1b9162ca79d req-894af5f7-3a7c-49d1-becc-023168f3e50f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258918 Nov 08 04:25:14.870364 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2bba978d-0a2f-448f-8967-72793c6aa9ad req-46478875-14fd-411c-aa04-9062de39c300 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257416 Nov 08 04:25:15.163916 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-de50f16a-396a-417a-adef-5f5e0604688d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:15.960062 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7139c004-62a3-4eaf-bb31-2a879d829d9d req-ab6008f3-cc2e-40cd-9ca4-530bb4123de8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249572 Nov 08 04:25:16.009720 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:17.050620 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bf0a2275-7805-4ad2-a6f6-818cbe338f91 req-8699af32-1953-4ea2-81ea-328e5ff4d194 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253170 Nov 08 04:25:17.653316 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:18.144799 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3c0903ac-de23-4a2a-8fb6-87e323d3aa53 req-7751df04-9fc3-4707-927d-5200bedb560a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0290840 Nov 08 04:25:18.386573 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:19.236155 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de5df13c-51ae-4bdd-9e5f-19c469dfc060 req-3165a3e0-0f7f-4199-95f2-f4a388e76633 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260365 Nov 08 04:25:20.330935 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac57b330-05a7-4489-aa54-d58a319ed675 req-0a655eb2-c106-4a4f-b450-718271214429 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249860 Nov 08 04:25:21.423540 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f5f91c95-fe55-472a-a512-284216b3414c req-3aa16cfe-a3f4-4de3-81f2-7589bfb18c72 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0266249 Nov 08 04:25:22.516996 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-86fd943a-fcea-4afd-b42d-a26d1e5f9d0c req-c90d0abb-dd9e-4a60-ba94-698a71a8e4e3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0263591 Nov 08 04:25:23.607293 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f6fa6a2-3933-4904-9b6f-91775eee3fff req-a580702f-741b-4054-8157-a8baef028cea tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257165 Nov 08 04:25:24.355718 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:24.699474 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-84707a53-ba00-4f8e-9956-04222926e8ec req-f155da18-355d-4f87-a495-29b6310c5005 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0287516 Nov 08 04:25:25.791393 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-beda078a-eed9-48ba-a908-f9f3f3544dc2 req-b6c5bc7c-13eb-4f31-8544-253a2e19a429 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0269787 Nov 08 04:25:26.881305 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-56cd9e2e-9a13-4d3c-8720-1d4f71253e30 req-22736f9b-d4f6-4dcf-a8ef-74aee6599a3f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0255215 Nov 08 04:25:27.977465 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c738c243-f8aa-4c4e-abc5-11e322f452cd req-a788ae62-1f20-4da9-a1e7-2983b75ef7a7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0262668 Nov 08 04:25:29.067160 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ddebb53-482e-454b-b76c-8ff987fb60a3 req-13c6000a-9084-4aca-aca2-3b481d957ab7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254965 Nov 08 04:25:30.158503 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0bb8978c-f637-45d9-912f-09f73661f17f req-a87073d5-69c6-4d6f-8e9e-1bc100956630 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0265026 Nov 08 04:25:31.253397 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2f6ad576-0975-44c2-8969-6cee2755b8e9 req-dfe19d7c-0600-4dd6-94ea-30bf3ca15e5f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0294371 Nov 08 04:25:32.343865 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f047c505-7558-4456-8eb7-ade2aeefcc20 req-2a5f7bdd-06fd-4654-aaa0-86a52e115e62 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256770 Nov 08 04:25:32.956634 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:25:33.439463 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ad3e699d-3c16-4606-b005-1904dfaef8a5 req-4a08f3cc-0e41-4084-8183-35b642bdc4f9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0250838 Nov 08 04:25:34.530045 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6a2bfc20-379e-44cd-8a2a-a68b96826521 req-1146dc4b-35ee-430a-8018-c7f0a6acd3e3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254118 Nov 08 04:25:34.654648 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65dcf660-b008-467b-acd1-210c205e6114 req-dabad4cd-0a52-47a3-a349-d84cda092db0 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0376832 Nov 08 04:25:34.727778 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dcf660-b008-467b-acd1-210c205e6114 req-628f9183-bdf0-4706-a33a-6a30650f7d20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:25:34.729256 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65dcf660-b008-467b-acd1-210c205e6114 req-628f9183-bdf0-4706-a33a-6a30650f7d20 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 1098 time: 0.0432076 Nov 08 04:25:34.828801 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dcf660-b008-467b-acd1-210c205e6114 req-08a558bb-ffef-42c6-95c2-c232a7f1bcc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:25:34.830247 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65dcf660-b008-467b-acd1-210c205e6114 req-08a558bb-ffef-42c6-95c2-c232a7f1bcc1 service neutron] 10.222.0.16 "GET /v2.0/networks?id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 200 len: 914 time: 0.0825796 Nov 08 04:25:34.874131 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65dcf660-b008-467b-acd1-210c205e6114 req-1ac8e5fa-8d03-45a3-9dbd-5d09584c7748 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3 HTTP/1.1" status: 200 len: 217 time: 0.0359278 Nov 08 04:25:34.920592 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dcf660-b008-467b-acd1-210c205e6114 req-231a6000-5e58-4bc8-95ae-6895d547e96c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:25:34.921977 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65dcf660-b008-467b-acd1-210c205e6114 req-231a6000-5e58-4bc8-95ae-6895d547e96c service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b7476cdf-e453-4db0-a095-7baf9278351d HTTP/1.1" status: 200 len: 853 time: 0.0418222 Nov 08 04:25:34.952866 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65dcf660-b008-467b-acd1-210c205e6114 req-b64d9a0d-ba67-4f14-9cfc-6e27f20e9db0 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0232723 Nov 08 04:25:35.041489 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65dcf660-b008-467b-acd1-210c205e6114 req-7e375753-05b8-41ee-87bc-7f09d77c118e service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814190 Nov 08 04:25:35.127602 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65dcf660-b008-467b-acd1-210c205e6114 req-108dc69f-2839-4ea3-808a-61822c351818 service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0796485 Nov 08 04:25:35.622230 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c2c29b13-dc2d-482a-97d9-bd08a3417267 req-0bc02d7d-4547-4e80-abf2-fa4684abe11c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0268629 Nov 08 04:25:36.711169 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7b98e7df-a69f-420d-828b-c51e8c2774f2 req-9fb343e2-7be0-4961-9063-12f17bf10dcb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256450 Nov 08 04:25:37.805138 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-09b64887-0710-4561-9cc1-9f3c9d2856a0 req-2d5ea77f-17a6-4f69-ad01-785fcb6693bc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0293391 Nov 08 04:25:38.895536 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dd520685-f831-4ad7-9748-912badf195d0 req-1bc2f362-dfec-4b9b-9c05-279c7e265e28 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257921 Nov 08 04:25:39.985562 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be94c9a1-ac35-43cc-866f-4affbc3abcd3 req-8778de15-1a99-4716-ad03-795769bfb959 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258729 Nov 08 04:25:41.083299 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-930acdc0-621e-4e45-9f7c-0ec10c7afb06 req-697ff674-3c6d-4621-a442-c731e8e72df8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0288620 Nov 08 04:25:42.173645 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-46533edf-debc-4625-8e11-a56df82a9379 req-0a992241-184f-47ff-a05f-2c43660ae2a3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0265028 Nov 08 04:25:42.666443 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-da70125c-e36d-4c20-b9c1-51132eec8353 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:43.263758 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1c7b733f-8725-4c5c-bebb-8b079f2280a6 req-42777e45-c667-4151-9322-b87ec56e33a2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253859 Nov 08 04:25:44.358193 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1d913ae7-7d77-4e3e-8894-3b7d7afabe90 req-91116f7f-a8f8-4182-9d99-84bc4409a6d5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0282290 Nov 08 04:25:45.151789 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b6769068-98e9-42a1-b7ff-14b4f3fb7fba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:45.449731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-221e60a3-a4b0-4c0b-87ac-f4f18161e077 req-8fea0194-5073-4c4c-9dd8-d883b0001d5b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258012 Nov 08 04:25:46.008950 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:46.541218 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d59019a0-fada-4112-8018-43fd4dd3df78 req-c35454eb-646a-4ae1-8cc8-9a8410366aca tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0250716 Nov 08 04:25:47.635129 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ad666143-05f8-4a51-979e-21e42c5e3670 req-29188dbe-1d7e-4c28-af50-478f8c074831 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256627 Nov 08 04:25:47.660419 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:48.391973 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:48.726767 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ecd9d97-fa22-48ea-8985-4749c5fabaf2 req-cd8a4d56-137e-491d-a161-4e887cffa4ad tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256960 Nov 08 04:25:49.818698 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d5616909-022a-47be-9ea5-3c8a0a614953 req-cc0a1cf0-382c-47ed-bd4a-6d9bcbc54efc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254815 Nov 08 04:25:50.912131 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bfd6893b-b142-469d-830f-3a14ef9dea33 req-92b2f2b0-fe3d-4fa8-9346-b9b5b954cc5c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0286460 Nov 08 04:25:52.002667 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7a71bf2f-ac2b-4441-9e08-c3efa81ea7e1 req-09024094-88c2-4c98-8f61-53b6561aa4fc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0248322 Nov 08 04:25:53.099278 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e6cc7afe-e77b-46e4-98f3-64ae15458557 req-094257cf-6489-4e5c-aea6-677e5a70da5e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259235 Nov 08 04:25:54.190702 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-30a8c6f8-ec21-4b6d-b283-c074d9316a26 req-47dbaf76-e0b7-4ec3-9112-a312dad58c5f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0268784 Nov 08 04:25:54.332352 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:25:55.281779 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4fb14070-0f69-4a70-ac84-5bebb482633e req-5d3c2dad-3d7e-496a-ac84-85cbe8431d53 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260458 Nov 08 04:25:56.373636 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d634a46a-6bed-400d-9081-da9926d21fd1 req-b2d1144a-8c79-4d50-bcbf-929461ef3475 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0276549 Nov 08 04:25:57.468142 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f08ab33a-3eb1-4cb2-8fbc-ae030bfba216 req-fb36bbe0-2f8c-4756-8878-d7777f903b91 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0295515 Nov 08 04:25:58.559267 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-28417379-821c-4bd2-a5ab-4d21473c0cb9 req-8c88bb1f-2411-479f-a345-5d0f2f3884cc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0268610 Nov 08 04:25:59.651644 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3a085d89-ccfd-4cee-9aaf-a2dedd836699 req-6bdeaf60-25c7-4662-aec1-314099b0e9a8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0265710 Nov 08 04:26:00.742256 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-83632a26-1bee-4a21-974e-f45864e6bb2e req-12e0e565-c413-47e4-b694-4b3a723be647 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253830 Nov 08 04:26:01.833817 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8cbde8d3-cc9b-4a7c-86b9-2d51949dda35 req-8b3d7507-069e-4a37-8ae8-949f34196142 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256128 Nov 08 04:26:02.925003 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e640fe32-2a7a-4166-b27f-f776d7a8b530 req-05f04207-f947-49ae-8d77-efdf49148b3d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0248423 Nov 08 04:26:04.019766 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e93a7eed-ed4a-4490-8e7a-f39c1c91c9b7 req-9ac52b6a-8a8f-4f1e-a2de-ed84bc65ef49 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0284252 Nov 08 04:26:05.111012 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aa60a343-d4cf-42e2-a52a-c9d6471d4d9a req-916928fa-f48a-4b69-b488-bf7a7daeb1c5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252624 Nov 08 04:26:06.203004 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ef71b0f-cc88-43a5-acfd-0bf0297d8033 req-64c320f9-3371-45f8-bc64-cfd0c27485b0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259125 Nov 08 04:26:07.293562 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c26b26d-f2e9-44bf-ab78-ffd3edecc280 req-f58b47f9-97aa-4bd3-afb6-8bcf2be2fe8d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259559 Nov 08 04:26:08.392381 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b59b53d0-740c-4118-abd3-96df0f286ab5 req-c0e74483-3ce3-44a5-9272-5a91bd408464 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0284038 Nov 08 04:26:09.483977 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a4fc6b55-2aaf-4b84-8dbb-c4ddb8291f8b req-992f8b25-fa32-440c-8067-bf41374b56f2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256855 Nov 08 04:26:09.955241 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:26:10.578712 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f7ee99a-5721-45bb-9bb2-e8886eb7f163 req-986c5829-cd1a-4a06-baa0-8c3f01ebd5b8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0294614 Nov 08 04:26:11.672181 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ed579a4-becc-441b-aa36-3f27c5ba9a1f req-f638fe8d-45d0-4499-857f-46e5b3869f7a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0291312 Nov 08 04:26:12.648504 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-4d81630a-cef5-407c-b58c-c9a741788575 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:12.764211 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b349efc2-d8f1-4693-a3c5-019bb885098f req-1eeab14e-6093-4c52-a4a7-f5ae54e9cfe7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0263875 Nov 08 04:26:13.855716 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cea0e37b-1555-4f1a-aaa5-fe1eacdfbeef req-4ae9ca98-4ce7-4bf7-a6c7-379dd53d8b35 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260785 Nov 08 04:26:14.944940 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fef94d76-c248-483d-b68d-460fcd9a2a26 req-2bae477b-feab-40ec-b259-76cb152f476f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247641 Nov 08 04:26:15.191357 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3efc0eb5-9750-4494-8718-415b17104348 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:16.014123 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:16.035106 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-413b4955-42ae-499b-8b0f-9d33b224c3c0 req-69c86dd4-b5fe-4dc4-a822-e137109ac298 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0250447 Nov 08 04:26:17.128984 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4525d7e4-4bd0-4656-b34d-7c4dd7f2ffc4 req-f3906b4d-a375-40a6-aba4-071c76926558 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0283849 Nov 08 04:26:17.657449 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:18.219457 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3e060706-2736-4c19-91d6-8bb0a7aa434b req-3996e442-63f6-4d6b-aec3-a19e2af8433e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0249546 Nov 08 04:26:18.414125 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:19.312983 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2d50ce9e-9061-419d-9bc7-f1da33db42bd req-8c492f5e-b27f-49c8-b818-30eb7ed8e197 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253839 Nov 08 04:26:20.518124 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-445b8ac0-e5f1-4a64-b634-848564b3e839 req-a4976e91-8452-4616-a017-914ce6398f11 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.1384079 Nov 08 04:26:21.610915 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b3affb5c-7dcc-4927-961d-52974a73d7fb req-70460ed8-1f75-44e4-bb29-99229df15654 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260615 Nov 08 04:26:22.702633 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-95682bfd-33b4-4e42-9f5e-ff10d9faeaaa req-3cf0a1c4-80ba-48c3-88a5-c1253d3e6be3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260913 Nov 08 04:26:23.798659 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-812f6ba6-1938-40c4-a99b-7d1c8a59c862 req-dc0314b2-f68e-4c6b-9320-560f14d2940b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0293510 Nov 08 04:26:24.351450 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:24.888714 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8b809028-7bd6-492f-8a40-276368494db5 req-4be81e7a-c6d2-4efb-91fe-38c59d34a063 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0261030 Nov 08 04:26:25.980540 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-abb498d7-9b39-4492-aba9-e98414d45afe req-c50af5d3-ff8f-44fb-95ff-3901bdab3612 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0264170 Nov 08 04:26:27.069997 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5408353-5528-4313-ba89-96d007d484c7 req-ff63b1b0-fcbe-4094-b930-79c07937a57a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259862 Nov 08 04:26:28.166295 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1c74017-0f4d-4d6d-9bcd-3240ead280d3 req-453f9c84-a8d3-41db-bec3-a11ee6239cd6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258572 Nov 08 04:26:29.259270 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-041816b8-c450-4bc0-8049-cbdd3127e6f5 req-d4cd72d8-5694-49ab-ba9b-bf158cd0fc6b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260959 Nov 08 04:26:30.355060 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a10dea87-5bfc-40e5-90fd-950dd8565b8e req-01f6310b-f0a0-44d9-b877-970d33aa25c2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0290701 Nov 08 04:26:31.444402 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1eee0703-0d63-4804-8e3f-296a71b20c17 req-7153860e-7577-4f09-83bd-10558ec940cb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0251846 Nov 08 04:26:32.535449 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-439d447f-e649-4129-ad63-3d7a10295d09 req-919aeef1-929f-44b2-b90f-5094c66439f8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252593 Nov 08 04:26:33.628218 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cecdcb7f-6de3-45e5-b81f-1cecca7e358b req-8e6d325d-81a7-4145-a19f-39d2115ddc02 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252187 Nov 08 04:26:34.654514 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-775704e7-9027-4465-92dd-8d179bb3b71c req-dc279de3-9c7c-4e6f-a46e-62cf25b86323 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0385137 Nov 08 04:26:34.725831 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-81d29a7a-8f43-41b3-887b-1bb69932de0a req-39cf9628-abc0-4138-b992-bce8ebaeec39 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0297480 Nov 08 04:26:34.763686 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-775704e7-9027-4465-92dd-8d179bb3b71c req-7941ecc0-b920-4f38-9dca-28380cbac505 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:26:34.765128 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-775704e7-9027-4465-92dd-8d179bb3b71c req-7941ecc0-b920-4f38-9dca-28380cbac505 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0418129 Nov 08 04:26:34.864476 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-775704e7-9027-4465-92dd-8d179bb3b71c req-545294bc-576a-4f45-baa8-70f35f85a05c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:26:34.865801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-775704e7-9027-4465-92dd-8d179bb3b71c req-545294bc-576a-4f45-baa8-70f35f85a05c service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0808625 Nov 08 04:26:34.931403 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-775704e7-9027-4465-92dd-8d179bb3b71c req-44d19c67-7092-483a-bdfb-82b2edc34522 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0585904 Nov 08 04:26:34.978981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-775704e7-9027-4465-92dd-8d179bb3b71c req-a42ba921-e0cb-4781-8992-9b8b9a9ab7d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:26:34.980380 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-775704e7-9027-4465-92dd-8d179bb3b71c req-a42ba921-e0cb-4781-8992-9b8b9a9ab7d6 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0424197 Nov 08 04:26:35.025892 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-775704e7-9027-4465-92dd-8d179bb3b71c req-50b7628a-16ea-4efa-8cb8-ee5263b4a891 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:26:35.027379 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-775704e7-9027-4465-92dd-8d179bb3b71c req-50b7628a-16ea-4efa-8cb8-ee5263b4a891 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0393205 Nov 08 04:26:35.116562 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-775704e7-9027-4465-92dd-8d179bb3b71c req-60ff4fb0-4640-4bfa-a5c1-aad284c655e0 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816822 Nov 08 04:26:35.200155 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-775704e7-9027-4465-92dd-8d179bb3b71c req-4b0cb863-6090-47a9-9d5a-59ad2d1e2f5d service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0768661 Nov 08 04:26:35.821065 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2689edb0-ee99-4519-b92d-cd6103272e98 req-c3abc226-9010-4153-b02d-087816daa24b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0298243 Nov 08 04:26:36.913184 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6ea458a2-d38e-4097-89a2-47a1c039947e req-5249d007-f0e6-45f5-86ae-118727dfd938 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0261765 Nov 08 04:26:38.004293 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c421dcee-6bd9-4418-a1c1-82dbbcbf9159 req-d71a1683-f330-4b14-a847-fb5f8edd0f2f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247407 Nov 08 04:26:39.096070 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be15a7d8-fe18-4d58-9d3b-0531ac46dff7 req-d9b84fb9-e2a5-4cf0-b731-277069f710be tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247841 Nov 08 04:26:40.186240 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-62ac8dfe-a990-45bc-b897-d775b36f2bbd req-abefa748-01ec-4b88-8a8b-6e5439a9ed03 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0248866 Nov 08 04:26:41.277757 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-47de33ce-b7f8-420a-84ea-97bc81dea55c req-f8ab6f51-ebc2-4a74-a26e-53b357d6569c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253756 Nov 08 04:26:42.376127 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6784e668-5b6f-45c7-aa2a-3668d4727fc0 req-822611c5-a861-4688-bdbe-ee6213af8dd1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0290198 Nov 08 04:26:42.670737 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c536d716-0609-4b21-a4e0-b80c77010f2e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:43.466585 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b6a9002-5f45-4f06-b23c-cd0392623c43 req-bafe823b-5308-4a15-9ad6-eb87b7c07016 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254772 Nov 08 04:26:44.558435 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f726e73-114e-444a-a9a8-1abad3c7e38e req-7ab03fb1-c55b-472e-91a8-3452bbf8343d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0263100 Nov 08 04:26:45.148372 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bcbf1cfc-36aa-4ebb-90ae-3ffc7a794083 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:45.698717 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6dce5fd4-a416-4852-8711-5f7c5f749ba1 req-b8bfca60-e795-4f48-831c-600fa38cc52c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0742254 Nov 08 04:26:46.017016 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:46.790059 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-937f3c85-0583-4dbf-934c-d2870750276e req-26ddb5df-0dd8-432a-9dbf-576ee90b024b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254076 Nov 08 04:26:46.953947 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:26:47.651280 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:47.879401 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a98ad6d2-7ac2-4d9e-bef4-19d11c7640fc req-aeeddadb-761b-4449-acdf-83c131fc7da8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0250988 Nov 08 04:26:48.390390 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:48.972819 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-72b818ae-0ee5-4344-b2ff-4a7051b3beff req-7c4f19a3-3d3c-40bb-a2d3-4f29b4114155 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0295982 Nov 08 04:26:50.064244 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-36d114aa-3744-4887-9415-260d90080e2a req-313a5ea0-3684-4530-8954-f80c2141b5b6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256090 Nov 08 04:26:50.188564 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [req-fbc244e2-775c-4678-9927-034c074f9970 req-363d261c-105a-475b-9fe2-045536baf6ed service neutron] (101664) timed out ('10.222.0.16', 51197) {{(pid=101664) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 08 04:26:51.153675 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4a537065-d2fb-46b3-aeb6-21296cda902a req-9dd84dec-5f50-44c5-ac13-acac298b655f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252838 Nov 08 04:26:52.246059 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f1148143-a72f-45ec-97c9-5ee24e793037 req-629cd322-f117-4865-b1dd-7478ddf8a10b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0274556 Nov 08 04:26:53.337265 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-74a92fcf-fb78-4093-bc0f-7ffb99de5060 req-0a7c0df4-2d1c-43d5-99bc-452ba7eb4267 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260139 Nov 08 04:26:54.368104 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:26:54.427920 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0bf421e6-dbdc-4a4d-beea-e18976d341ca req-d3a33ba9-780c-4e23-afb1-8c612728cf1c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259171 Nov 08 04:26:55.520919 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-78bcc0c0-dafd-4e10-b543-fdf83e9ba966 req-ea08a5e1-524c-498f-8477-dd8404350e20 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0278924 Nov 08 04:26:56.612968 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91bb7caa-f49f-4cba-95d4-e20a6776efca req-cba3b322-4b05-45b9-9adc-319ed41d8841 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0250943 Nov 08 04:26:57.705363 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-764bb263-f897-4fea-abdf-6724c6f06121 req-3861537c-f9cd-4c1c-a8c6-ba264af26dd5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0280733 Nov 08 04:26:58.798984 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b3a44469-782e-4a23-976f-6fd3fac3c083 req-64b78747-f0db-427c-b422-f0eb6e4f45d6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0255513 Nov 08 04:26:59.888526 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-576306ca-66b0-4135-b9f9-129fce953aa2 req-21709ca8-849f-47d7-9a90-62cae66a5b80 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259931 Nov 08 04:27:00.980163 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-09244d1e-d36d-4d1b-a9ad-51cd7ed71272 req-1cddb43f-d897-4167-a670-ee069d50d8ad tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257730 Nov 08 04:27:02.072852 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a9a023a1-0b58-484d-a2e7-b7292f8f4e44 req-fea1118d-c063-41fe-bd3d-ae52e9165249 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0275121 Nov 08 04:27:03.165504 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e803b1cd-7b11-470c-8f40-4b401029e54b req-a6431e3a-9f16-4534-a01b-7bdefc01e499 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0255868 Nov 08 04:27:04.256613 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0f9bb8fc-5fb5-4928-977b-b83c3e6aab9d req-a3bd39ab-31d4-454a-af68-7d8ae6b7bda1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257304 Nov 08 04:27:05.346546 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-463992bc-ae05-4b2f-8aa4-53be92724a18 req-e14aa0c7-2dc8-467a-bcda-9167bd3eb6ed tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253768 Nov 08 04:27:06.437220 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-951a6b6c-d197-4e73-8f5d-d7efaaa3cbf1 req-8a60fc1f-ad64-4976-874a-4850ca006f22 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258491 Nov 08 04:27:07.528631 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7a930d1-a5da-435c-84c2-42ca7c7f80df req-812850d4-4413-4572-98c9-5bb668b623a3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0262539 Nov 08 04:27:08.624885 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7fb2e856-cf66-4183-a415-ff242f36efb2 req-7f8948a8-1d45-40af-86f8-1b0440e75cec tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0292842 Nov 08 04:27:09.715024 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1a43731-5213-4b02-bba3-940407a9e0c5 req-de0d4ac9-8f6c-4ffb-bb97-e760b572576c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0255487 Nov 08 04:27:10.810264 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a8fb12a8-1c08-4b71-b05a-6eab203d13e2 req-c7f35dfc-dfc2-409a-9bc6-34f62d70d71a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0255642 Nov 08 04:27:11.901202 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bbaa3aac-7475-4860-abe9-fc84f715d3a1 req-7e424779-9fff-4e0a-83d1-255ab01c4ba0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0255759 Nov 08 04:27:12.664726 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-52ea7298-8a39-4c7a-9183-ed80de544ae3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:12.992748 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6794138b-3c88-4f1a-950d-f84dab84ae3b req-d0a30949-fc78-43ea-a621-a9805c84e628 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0268359 Nov 08 04:27:14.082822 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f2b5477-9afb-420e-b382-0f792cc10ab7 req-72454ef6-462f-4caa-9f0a-fb5bf6491d2a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254552 Nov 08 04:27:15.175693 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3b89a1fd-9f9c-4bf8-916f-e8a19ebccafe req-25417d63-b654-4518-97bf-3fe1fcc557f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0284262 Nov 08 04:27:15.179005 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bce9c0e9-2e75-4e22-a3d4-8c09c2460253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:16.039111 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:16.267021 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de6e6285-a000-4426-a649-5bd2d1756c77 req-61bc1365-6d95-4e0d-8e77-e642b5713e21 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252831 Nov 08 04:27:17.359105 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f441d259-de7f-420c-ac62-f438f0bbb930 req-50a05d6d-37ea-462b-915e-1192be7e1380 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0251482 Nov 08 04:27:17.675900 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:18.376194 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:18.449635 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c75bcfb9-59dd-420f-af63-490baad0ca05 req-5bc2bbf2-7e39-4b33-add9-287ea969eb6f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254340 Nov 08 04:27:19.540156 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6f5a82a9-bc8b-476c-ab03-bc9866483f59 req-2807d65f-fa6e-4496-82ad-7a0f7c95c84b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258906 Nov 08 04:27:20.631004 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5d611871-3482-4f4e-ba62-c5185c49e387 req-32e4d4fb-7945-4d10-ab4b-404efdf9bdaa tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247760 Nov 08 04:27:21.728022 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-513342a4-fa1c-49c0-ae36-351d0dd56837 req-dc4059d2-efca-4df6-ad04-f10111fedd6f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0292301 Nov 08 04:27:22.822301 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1aa20e27-a6d1-4f4c-a101-d159bcfdffda req-9eb9efad-6ad7-403f-a5ba-4bd2023f67a6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258827 Nov 08 04:27:23.913570 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ab039049-efc3-490a-806d-a1ed50127b5b req-15b82a6c-16bd-4181-8445-66f9e7ab6d92 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252845 Nov 08 04:27:23.952838 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:27:24.378497 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:25.003998 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d13e461-b0cd-4bd8-8d96-c9dd5482860b req-1358d0f5-b4df-4eb2-9e43-4ae1dcac7e51 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0255697 Nov 08 04:27:26.110836 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a3e75088-04e5-44d0-8314-b1fca7306b82 req-49fea47c-df75-428d-98fa-8fd557152dfb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0263317 Nov 08 04:27:27.200613 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c9c454bc-c7b2-44f1-8438-8b81c32e0abe req-74cf9f28-7e58-4cb2-a2d6-4330f7f1cd80 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257511 Nov 08 04:27:28.299547 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-30b4557c-032f-4959-a94b-b961893d356a req-698204b5-fcef-4a0e-afbf-3cea1253f640 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0288510 Nov 08 04:27:29.390926 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df280ee8-49ce-4050-a815-182741c7b55e req-faafa0a2-d71e-4951-bd5c-d43c11534638 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253301 Nov 08 04:27:30.483175 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-168cc3ef-8c98-43a3-bd9f-34f9ca3ab2c9 req-93fef0f8-8df9-42b6-b7b3-07b071dd7c74 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258529 Nov 08 04:27:31.574982 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-50f96b8f-70cb-4833-875c-2404bd08c2e1 req-1de2808b-8c5e-488d-8ea1-003e8e14a20d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0264385 Nov 08 04:27:32.664655 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a2d77106-0283-49b9-bb93-64f6411b512b req-e8de5b53-4b1d-4893-8b5d-bdd8b37233b7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0255849 Nov 08 04:27:33.761019 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-40f41601-32e8-4349-ac60-fd0a3e7095a1 req-0a265b3f-f397-4cfb-b9d9-9e07eb51f79a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256152 Nov 08 04:27:34.687708 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-8a8ca66d-3245-4e47-9184-4ec389121cd6 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0824730 Nov 08 04:27:34.757701 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-e446b740-1cf4-4e47-97da-69005b0fd4c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:27:34.759156 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-e446b740-1cf4-4e47-97da-69005b0fd4c0 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 1098 time: 0.0398331 Nov 08 04:27:34.863242 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-73c352a1-c3fe-40c8-a889-403ce9fc7b06 req-54567153-50c6-43ff-a97e-3a4c6f73df87 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0331132 Nov 08 04:27:34.883423 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-293fac2f-506a-49c0-bb3b-13974e086970 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:27:34.884843 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-293fac2f-506a-49c0-bb3b-13974e086970 service neutron] 10.222.0.16 "GET /v2.0/networks?id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 200 len: 914 time: 0.1073520 Nov 08 04:27:34.924498 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-d2269ca7-cd68-43ec-8d7d-6a4333e05f4d service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3 HTTP/1.1" status: 200 len: 217 time: 0.0326929 Nov 08 04:27:34.973757 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-d0b5a739-4328-45cd-9b3c-43d63dd09dae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:27:34.975708 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-d0b5a739-4328-45cd-9b3c-43d63dd09dae service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b7476cdf-e453-4db0-a095-7baf9278351d HTTP/1.1" status: 200 len: 853 time: 0.0437162 Nov 08 04:27:35.005683 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-44d40fda-35e7-44d3-8991-cb8e78d8a4cb service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0233483 Nov 08 04:27:35.091257 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-3889b72d-e93f-4dfc-952b-bd80ee471e03 service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0780337 Nov 08 04:27:35.180431 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b57a3654-0bcf-4308-bcd7-f563af2e01b5 req-6f7f6567-b0e1-482a-ae64-75ed7d5c5af6 service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813711 Nov 08 04:27:35.953518 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51d64178-311e-4212-aeb9-7943214bd16c req-e9a69cbe-2ba4-4256-91e4-c662cca968f8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0262554 Nov 08 04:27:37.043930 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be62ada7-dfb4-46df-b880-fea0e5b8b1cd req-af5e6144-0043-4dc6-8df8-51c5320a1135 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254829 Nov 08 04:27:38.134367 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a344d31c-a7f9-45db-bd38-ce088b0794d4 req-2a678455-53ee-4281-8bb2-b0ea2fc37546 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258212 Nov 08 04:27:39.227868 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02a522af-d430-4e10-8697-dbde972f36da req-71cb74f1-0952-4a04-896f-3cea29f96be2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0288160 Nov 08 04:27:40.319095 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3adf4ab6-23c3-4774-965a-131e0ee7cc8c req-da0543c8-f7b2-46c2-862e-6a51f2f171d4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247765 Nov 08 04:27:41.425030 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6f1dde38-4105-4008-8a08-f964e941bd31 req-1978e384-225b-4eee-9856-541490164f90 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0345678 Nov 08 04:27:42.517019 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-76209d1c-96b4-44ea-8501-14a93bb6b2c0 req-6c4ede66-a07e-4328-8153-7647c1b13292 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258825 Nov 08 04:27:42.649791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a9bad31f-c8f0-4b39-9454-69ee42fbb5b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:43.608533 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f4d950c2-468b-47b4-8ac9-ab37bc74f7f7 req-6f91dffe-39eb-4d2f-90ee-e08955d38c41 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0263205 Nov 08 04:27:44.698503 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f868673d-9ca8-4dd9-a133-76227b9c3910 req-905889f1-f29a-479d-93a7-4a259e066cac tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252469 Nov 08 04:27:45.143688 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a2226c25-3ac8-46fc-a05b-9d6e6b14c75f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:45.796288 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2a8139d6-07d7-4af4-a599-44577d1cab73 req-acb5a78a-7d81-4c46-a7b4-75d6520cfb90 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0284038 Nov 08 04:27:46.021213 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:46.889882 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-585c71e0-14bd-4a1d-9cf5-b5075568a1b8 req-482ba2d7-3e4b-4ae0-bb90-3e76d8aa62bc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252554 Nov 08 04:27:47.660739 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:47.980763 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3261abe0-62c1-41d2-af49-1cfd0eee2b58 req-7bf5af06-db33-48c9-b402-49886afcb5e3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0259445 Nov 08 04:27:48.363907 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:49.077775 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3af852b1-251e-4be7-8290-7b76716ce776 req-18fe803c-869e-4b34-815c-251a418d0965 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0263326 Nov 08 04:27:50.169264 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a87f5eeb-7098-4dd4-983e-50397fbabec7 req-2dd10495-5c3c-4a0e-871f-b4be0f6d29cf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0261676 Nov 08 04:27:51.259282 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-933486de-1f1d-4c54-bf11-7ea29a94f0ea req-8d410442-c80c-4bca-8621-bda00043397e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0255220 Nov 08 04:27:52.353285 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bed1ef5c-9da3-48fb-a2e9-336805a5d0b8 req-a250dd19-7489-4fb5-b152-f359944c635e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0278778 Nov 08 04:27:53.447362 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1eaa1872-a4f3-4aef-859d-410561ae9208 req-75a16fb2-f738-42a8-85c0-90f4d2c2d913 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0266244 Nov 08 04:27:54.369637 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:27:54.537737 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6c0e4954-4ce5-4b5c-ba3e-5700be497c76 req-4267ad06-0288-48fc-8c58-31bc292bc3ae tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247607 Nov 08 04:27:55.628961 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-11ed667a-ed56-4782-b0a8-26f4d087eb75 req-2a4dc164-7e19-43e8-85ed-36b7da2848d8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0246747 Nov 08 04:27:56.726620 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-88cffa51-c5a4-48c9-9c61-d1341df78b8d req-7a66ba80-fa69-4361-b751-d02b28f8aad6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0258219 Nov 08 04:27:57.816454 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f0040c7e-a759-4084-b5ca-882bf59f2ea9 req-c38e016f-8e24-4ed5-afdd-89a789861da6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0252466 Nov 08 04:27:58.911970 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c63b21c2-a14e-4b78-b134-79a0e7226b4d req-1c398625-1b63-4ea7-ba24-492024a88f1f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0286191 Nov 08 04:28:00.008855 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e1f3d47d-8d05-4d4b-b936-af0ce9866957 req-ab7295f1-44f6-4b44-bc66-da85bf880295 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0267265 Nov 08 04:28:00.951487 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:28:01.098953 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-feac1e27-5be6-470a-a846-87a0c8fa7144 req-ef1b9aa3-c79d-44a5-b4de-c5c854138acb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253425 Nov 08 04:28:02.188595 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fe5a21bc-9229-4c53-9967-fb46ef8830f6 req-afd6937a-254d-463a-b3cc-ea931c269cd3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247395 Nov 08 04:28:03.277786 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-54f49df9-46a7-4ab5-9f38-f72f6f1260ab req-66ecb0b6-a80b-4ff6-a032-bf6f03d02a25 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0245473 Nov 08 04:28:04.376655 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac9e170a-7a2f-4098-a404-56fdc56ecc2b req-7752ee7b-79eb-48c8-9472-ca05fd572198 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256243 Nov 08 04:28:05.472486 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-01f0a151-2fab-4619-bcbc-943269fb0967 req-dc580f47-c8e5-44ad-a844-567bd210b762 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0286233 Nov 08 04:28:06.565028 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-86c60f68-04fd-42ee-8dfa-1234d08dc668 req-778b071f-780f-487c-b06b-06403da727ef tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0257978 Nov 08 04:28:07.659113 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e12ca131-44d3-4eb0-b85c-282be9753005 req-d18de54e-850e-4372-ae4d-bcdf045d191f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253024 Nov 08 04:28:08.749196 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3303cb08-e4ee-46a0-9245-515149e39fe7 req-f0820b79-cd08-4796-981c-fc20c6a5a720 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0253084 Nov 08 04:28:09.843003 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e3596100-24fe-4207-b235-b61fac16d1a9 req-88993851-8b68-49b5-9fe0-12b5da022e0c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0296087 Nov 08 04:28:10.932923 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e6bf3746-e4b5-44f1-9341-a8f8ecaee460 req-6210bd67-5e9e-49bc-82f6-7d933196716c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247207 Nov 08 04:28:12.030928 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1c4d2b0f-7776-4086-91cf-9ace792f246d req-7933b96f-3d73-4904-b8f8-3a7607aeaf75 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0322893 Nov 08 04:28:12.652132 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a0585236-3406-4ce6-98a7-2ea802841aa7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:13.122354 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f4d8aa6-b891-4a80-b8cd-4ecf16e3a0e8 req-cffdb751-3287-4374-8ba6-17d8ac51f806 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0260932 Nov 08 04:28:14.211336 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-30f0e282-84b6-49dd-b54c-d88180d38d91 req-8555e7c9-5033-4eb2-bb0c-feab9e55b5a2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0256462 Nov 08 04:28:15.151468 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5b262372-a1d9-4e62-b92e-0d003ad5e0c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:15.300840 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-94dbffaf-8b68-4ee9-96be-d4565ae8a409 req-68ff54e9-ce2b-4f0b-b3ae-8453ab6b736f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0250659 Nov 08 04:28:16.094712 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:16.391532 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d11f9be6-f2ae-4355-a77c-e0b3f1e5eb06 req-18cc89d8-0874-4dc4-8680-06beeb8b78f0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0248783 Nov 08 04:28:17.483385 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ba9dd7c-9ddc-47fc-abc1-ac2271b7d710 req-3ac9c8a5-62b6-4aca-bf47-a3188cf91b8f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0247967 Nov 08 04:28:17.666268 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:18.380716 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:18.575472 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c84d5760-07a5-493e-814a-a101c50046ac req-cd5d22fc-8ef5-4196-8611-0b3cc1184610 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0273039 Nov 08 04:28:19.672848 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d84b7ad1-3334-473e-b7d4-3feba9cd5ece req-d336a994-c502-4ed7-acae-ad03dc2ae1fb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0290053 Nov 08 04:28:20.763491 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-63520900-e404-4b51-a708-b1e67b8d81e4 req-2758ef15-050d-42cf-bdd8-ec1b7f675f10 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=8ffed274-5857-44b0-acf4-2dd126fa410f HTTP/1.1" status: 200 len: 210 time: 0.0254211 Nov 08 04:28:24.368958 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:35.369329 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-ef2f6c77-e379-4a63-be4f-fb9b5a5de759 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0390878 Nov 08 04:28:35.465938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-d2fa27a4-48e4-4196-b011-e65fe300c055 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:28:35.467476 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-d2fa27a4-48e4-4196-b011-e65fe300c055 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0386150 Nov 08 04:28:35.568571 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-0d67ec7d-ce99-4cc2-af35-a3250247e37e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:28:35.569995 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-0d67ec7d-ce99-4cc2-af35-a3250247e37e service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0835233 Nov 08 04:28:35.632897 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-af3a76fe-6700-47c1-8417-b0bd9b5929eb service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0561111 Nov 08 04:28:35.682423 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-2d540d32-1978-4ed9-8a6a-8917a412281b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:28:35.683877 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-2d540d32-1978-4ed9-8a6a-8917a412281b service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0442641 Nov 08 04:28:35.727667 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-21d7a412-7346-4d1c-92c2-49787d977d1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:28:35.729057 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-21d7a412-7346-4d1c-92c2-49787d977d1c service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0374892 Nov 08 04:28:35.816697 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-c47cddd6-4eb6-416e-bce0-fd3689ab0e96 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803139 Nov 08 04:28:35.903208 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-501cce28-0c6d-4ee3-b95d-55b7ebe62570 req-84f5b0b8-2e97-4a43-949d-8503ef3c0f9d service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0797186 Nov 08 04:28:37.949454 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:28:42.659434 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d30f6be3-926a-4379-ba15-1cfb1028eb17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:45.209139 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-53d8433e-5fad-48a0-9b43-28098e4a9ba5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:46.051336 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:47.660125 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:48.385408 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:28:54.379518 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:12.658813 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-19066b3f-7cef-44cd-a1cf-be9ed56f4317 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:14.948696 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:29:15.187832 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8284e6a6-2a3a-4293-831a-80c898666a21 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:16.047480 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:17.664380 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:18.393157 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:24.364739 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:35.677884 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-6d30e2a8-b1f0-4377-b7d7-924e4937c7d9 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0381052 Nov 08 04:29:35.751421 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-79740d53-dbc8-45bd-b0ec-c4e0f0735923 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:29:35.752768 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-79740d53-dbc8-45bd-b0ec-c4e0f0735923 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 1098 time: 0.0424051 Nov 08 04:29:35.869444 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-033d0b49-11f2-412b-9335-b6fca80fa714 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:29:35.871056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-033d0b49-11f2-412b-9335-b6fca80fa714 service neutron] 10.222.0.16 "GET /v2.0/networks?id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 200 len: 914 time: 0.0992415 Nov 08 04:29:35.916252 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-2c79f453-9a30-4174-93d6-658e39ec82ae service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3 HTTP/1.1" status: 200 len: 217 time: 0.0373688 Nov 08 04:29:35.963212 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-7fe5261e-3845-4dbe-bf01-422b44fbd22f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:29:35.964571 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-7fe5261e-3845-4dbe-bf01-422b44fbd22f service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b7476cdf-e453-4db0-a095-7baf9278351d HTTP/1.1" status: 200 len: 853 time: 0.0421126 Nov 08 04:29:35.995884 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-512ee9fc-f986-4223-ab6e-1770ea9bf36c service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239370 Nov 08 04:29:36.086562 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-005f7860-a493-4169-8531-66fac2678cfc service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826204 Nov 08 04:29:36.454801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9050833f-9a34-496f-b36e-8a2bc42e849c req-774b9fbc-6039-44d1-bc76-2bccf98ff2a6 service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3609092 Nov 08 04:29:42.690273 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a3147e82-deec-4c04-8322-87072af84480 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:45.158671 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f66a46dc-c964-4bbe-ab73-7bdc182c4a8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:46.034824 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:47.703764 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:48.378075 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:29:51.947613 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:29:54.352587 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:12.684132 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bff37f00-b482-411a-90d4-59ace5d6d7d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:15.154054 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f77d6548-c0c1-4857-9521-ff25793b6797 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:16.028349 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:17.696781 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:18.399842 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:24.371677 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:28.947491 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:30:36.607720 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55eeb380-105f-479a-bfba-d858b547ed2e req-2c2f7b7c-ed65-41b7-934f-4a74dcb967a8 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0460739 Nov 08 04:30:36.718320 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55eeb380-105f-479a-bfba-d858b547ed2e req-ca1c6188-86d5-445a-a91d-31df08e63a91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:30:36.719937 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55eeb380-105f-479a-bfba-d858b547ed2e req-ca1c6188-86d5-445a-a91d-31df08e63a91 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0451598 Nov 08 04:30:36.822494 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55eeb380-105f-479a-bfba-d858b547ed2e req-1a7b6cc4-a9c7-45f5-9243-71d0c710ced0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:30:36.824090 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55eeb380-105f-479a-bfba-d858b547ed2e req-1a7b6cc4-a9c7-45f5-9243-71d0c710ced0 service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0844762 Nov 08 04:30:36.892528 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55eeb380-105f-479a-bfba-d858b547ed2e req-73a80c14-360a-4e93-8f64-0bb4aa941c74 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0608478 Nov 08 04:30:36.941467 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55eeb380-105f-479a-bfba-d858b547ed2e req-0335530e-4aee-4b67-85b2-f39fdf1fee24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:30:36.943074 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55eeb380-105f-479a-bfba-d858b547ed2e req-0335530e-4aee-4b67-85b2-f39fdf1fee24 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0436614 Nov 08 04:30:36.987975 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55eeb380-105f-479a-bfba-d858b547ed2e req-730bb6ce-317e-43f6-a6b0-7074978cc6c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:30:36.989452 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55eeb380-105f-479a-bfba-d858b547ed2e req-730bb6ce-317e-43f6-a6b0-7074978cc6c8 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0398448 Nov 08 04:30:37.093838 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55eeb380-105f-479a-bfba-d858b547ed2e req-b2b1f3c2-4dc3-47a8-937b-972de7d6b72b service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0973825 Nov 08 04:30:37.183928 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55eeb380-105f-479a-bfba-d858b547ed2e req-182c3de7-0f3c-43d5-aa0b-5d05baf3064f service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829148 Nov 08 04:30:42.662126 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-899db8f8-a5fe-4340-83cf-fe6609df4e29 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:45.141876 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1e15340f-a29b-4cc3-9e6a-74b23566a3d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:46.034134 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:47.722909 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:48.391437 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:30:54.324580 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:05.946290 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:31:12.684202 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9f5af4e4-6049-415e-9d7e-4ee94ed5f337 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:15.164162 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-31f01a88-e5df-4ee5-a1ca-13c544b6bb8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:16.044233 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:17.712627 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:18.380969 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:24.386895 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:36.387893 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-1e68dd5f-9845-4cfb-92bb-c4643d3e3ae5 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0411117 Nov 08 04:31:36.457719 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-4218154a-50e0-4623-ab22-f627787855e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:31:36.459250 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-4218154a-50e0-4623-ab22-f627787855e1 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 1098 time: 0.0382521 Nov 08 04:31:36.557822 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-4e81460b-8f97-4aa9-8b91-c0b9dcf0fd93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:31:36.559313 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-4e81460b-8f97-4aa9-8b91-c0b9dcf0fd93 service neutron] 10.222.0.16 "GET /v2.0/networks?id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 200 len: 914 time: 0.0809827 Nov 08 04:31:36.603927 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-f459232a-e69e-4573-8542-295ceeebd84c service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3 HTTP/1.1" status: 200 len: 217 time: 0.0367801 Nov 08 04:31:36.653065 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-dbd2f42e-64c3-4336-93d3-4bbff27c873b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:31:36.654373 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-dbd2f42e-64c3-4336-93d3-4bbff27c873b service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b7476cdf-e453-4db0-a095-7baf9278351d HTTP/1.1" status: 200 len: 853 time: 0.0424643 Nov 08 04:31:36.685613 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-3655dad4-6b45-4b8b-8cc2-1f30449c2230 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238411 Nov 08 04:31:36.775581 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-88587268-99c6-4144-8576-03aea2fc3f09 service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817966 Nov 08 04:31:36.861999 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55115c7d-b978-43ac-9f3f-2cde10a94b83 req-392a958f-02d1-4a73-af52-ecedf5f478a0 service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0792243 Nov 08 04:31:42.695482 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c90f6dd5-732a-4c98-a4c8-14e85be86a3e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:42.945270 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:31:45.140034 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-ad3b59b8-7e23-40a7-bcd4-746c73da4f2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:46.026162 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:47.681908 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:48.402876 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:31:54.345585 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:12.665534 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-2a8fd6f4-90de-476a-80a0-50f8a7615e14 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:15.162740 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-961b2c19-1e60-45f9-92df-3fb7abee9de6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:16.082038 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:17.682134 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:18.379586 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:19.944004 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:32:24.334390 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:37.728734 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d38bca62-1002-4cba-bba5-443304978247 req-cd73477a-7cad-448b-9983-938a50879340 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0808744 Nov 08 04:32:37.826104 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38bca62-1002-4cba-bba5-443304978247 req-a7b47a80-4d5b-42c5-80fe-b057d0d9f9f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:32:37.827793 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d38bca62-1002-4cba-bba5-443304978247 req-a7b47a80-4d5b-42c5-80fe-b057d0d9f9f0 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0391846 Nov 08 04:32:37.926468 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38bca62-1002-4cba-bba5-443304978247 req-864e1e05-f94b-4ba6-b501-3ffd1b23356e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:32:37.928525 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d38bca62-1002-4cba-bba5-443304978247 req-864e1e05-f94b-4ba6-b501-3ffd1b23356e service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0807722 Nov 08 04:32:37.992804 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d38bca62-1002-4cba-bba5-443304978247 req-63ae6da9-09ca-4d49-aacd-f6e2d7a28776 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0583146 Nov 08 04:32:38.038821 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38bca62-1002-4cba-bba5-443304978247 req-b89578f3-f955-4652-a480-f8beb8518433 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:32:38.040229 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d38bca62-1002-4cba-bba5-443304978247 req-b89578f3-f955-4652-a480-f8beb8518433 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0405133 Nov 08 04:32:38.085276 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38bca62-1002-4cba-bba5-443304978247 req-966630c0-4b7a-478c-9dc1-7dc54c453e3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:32:38.086805 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d38bca62-1002-4cba-bba5-443304978247 req-966630c0-4b7a-478c-9dc1-7dc54c453e3f service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392945 Nov 08 04:32:38.098372 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [req-d38bca62-1002-4cba-bba5-443304978247 req-8a68012f-e299-4a37-9bf8-80da03ea3248 service neutron] http://10.222.0.21:9696/v2.0/extensions returned with HTTP 200 {{(pid=101665) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 08 04:32:38.099297 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d38bca62-1002-4cba-bba5-443304978247 req-8a68012f-e299-4a37-9bf8-80da03ea3248 service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0047214 Nov 08 04:32:38.187886 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d38bca62-1002-4cba-bba5-443304978247 req-8ba377e0-b055-4fa4-927b-cc001be20c3b service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811193 Nov 08 04:32:38.273227 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d38bca62-1002-4cba-bba5-443304978247 req-0e17b0f0-e104-4d5f-8038-6e791cefd6c3 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0783477 Nov 08 04:32:42.664320 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7894718f-16ef-41ab-adf8-b7588d5f1491 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:45.172546 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5492f359-f2b6-4fb1-a4d6-f3e3caabb695 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:46.053138 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:47.685839 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:48.407518 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:54.361088 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:32:56.943094 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:33:12.089274 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [req-391e3df7-a3ef-4e02-90e7-2a5938fd7736 req-f6793055-10f5-4ce1-b673-9705f1f3925e service neutron] (101664) timed out ('10.222.0.16', 51233) {{(pid=101664) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 08 04:33:12.657736 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a85a72ba-eb70-4fb1-8a0e-f3667321be12 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:13.865001 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [req-18cf3de1-d67c-41d6-84eb-a38c6a7d8db1 req-86d6335b-8c2c-4507-a409-7c8c39be2bca service neutron] (101665) timed out ('10.222.0.16', 51242) {{(pid=101665) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 08 04:33:15.154858 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-129813ae-b80e-447e-8c0d-8a65652891a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:16.067954 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:17.674797 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:18.377805 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:24.365467 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:33.943285 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:33:39.664924 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-e9eec6d7-3930-4051-83df-5c82d294c486 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0436826 Nov 08 04:33:39.733787 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-2a891bb5-9a16-43f0-87d6-fbc2f9c9fa25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:33:39.735304 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-2a891bb5-9a16-43f0-87d6-fbc2f9c9fa25 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e5d49c7aaba44d380042cbff995c227&device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 1098 time: 0.0389261 Nov 08 04:33:39.837238 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-a8cada0b-5d3f-40b6-a5a0-2688bca8aeef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:33:39.839048 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-a8cada0b-5d3f-40b6-a5a0-2688bca8aeef service neutron] 10.222.0.16 "GET /v2.0/networks?id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 200 len: 914 time: 0.0844195 Nov 08 04:33:39.880282 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-d128ce44-16fb-48dc-ac99-13ddff7e0b60 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3 HTTP/1.1" status: 200 len: 217 time: 0.0332093 Nov 08 04:33:39.924384 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-d13d59d1-d4e8-4d26-8b71-7f0b80abcabd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:33:39.925764 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-d13d59d1-d4e8-4d26-8b71-7f0b80abcabd service neutron] 10.222.0.16 "GET /v2.0/subnets?id=b7476cdf-e453-4db0-a095-7baf9278351d HTTP/1.1" status: 200 len: 853 time: 0.0398901 Nov 08 04:33:39.955507 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-b899f26b-9b88-425a-a7ee-778b77cab2b7 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0232038 Nov 08 04:33:40.043801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-31082128-9242-4ee6-8c1b-5d6f640b06e3 service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814266 Nov 08 04:33:40.135697 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b15ac06-9abb-4734-a2aa-8f41e40adcaa req-71179d75-ce3a-4ec6-b19e-a19f3c207fda service neutron] 10.222.0.16 "GET /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847218 Nov 08 04:33:42.673924 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c9368df0-3598-4da7-846b-a11f8bdf06d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:45.177262 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-0f53146a-0255-46d1-b370-ef7ce99345c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:46.033845 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:47.730505 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:48.416748 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:33:54.370916 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:10.941899 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:34:12.662130 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-56e97959-9005-444a-bc0d-0cb07225bf93 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:15.164389 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-21ec0152-88e2-4710-b188-77f19a2bc1f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:16.061780 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:17.678543 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:18.375694 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:21.696010 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f7565e8-fd50-4885-803e-65bcee335e38 req-d155d6af-5f93-460d-809a-f9a298ea11d9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:21.697457 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f7565e8-fd50-4885-803e-65bcee335e38 req-d155d6af-5f93-460d-809a-f9a298ea11d9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.1476219 Nov 08 04:34:21.744088 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f7565e8-fd50-4885-803e-65bcee335e38 req-3e9c43b4-6852-4595-893a-18b5a4f83040 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405531 Nov 08 04:34:22.924370 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c3309e-8701-4dc5-8343-3fdaf3be6da3 req-28e0a369-910c-4414-a15b-2bf84ce3fafb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:22.925865 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e7c3309e-8701-4dc5-8343-3fdaf3be6da3 req-28e0a369-910c-4414-a15b-2bf84ce3fafb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.1001830 Nov 08 04:34:22.973191 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e7c3309e-8701-4dc5-8343-3fdaf3be6da3 req-7ef1d0ae-c23f-4fa2-b1b1-84566dca9cb6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407610 Nov 08 04:34:24.101174 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-200cf5ee-583c-4334-b3a3-d9b7c1f3f15f req-27e0fd3b-3590-4ab5-89a9-718bb525c8a1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:24.102646 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-200cf5ee-583c-4334-b3a3-d9b7c1f3f15f req-27e0fd3b-3590-4ab5-89a9-718bb525c8a1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0513809 Nov 08 04:34:24.147833 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-200cf5ee-583c-4334-b3a3-d9b7c1f3f15f req-80646d3b-ea4b-4393-ba55-3bdd4557800e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394039 Nov 08 04:34:24.375890 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:25.258929 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-086954db-81e7-44a7-aba4-b3dd8dbf4244 req-f568cfe6-bdf9-41ad-ba85-ccf29019739d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:25.260394 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-086954db-81e7-44a7-aba4-b3dd8dbf4244 req-f568cfe6-bdf9-41ad-ba85-ccf29019739d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0474353 Nov 08 04:34:25.306163 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-086954db-81e7-44a7-aba4-b3dd8dbf4244 req-87d9c3d8-7505-4c61-b36d-de55e781cca2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399249 Nov 08 04:34:26.418904 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebfa41c-ae63-472e-9ff8-f44678c21031 req-5a381ba9-8d27-4e22-9e63-d1c031583ffd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:26.420351 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3ebfa41c-ae63-472e-9ff8-f44678c21031 req-5a381ba9-8d27-4e22-9e63-d1c031583ffd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0481365 Nov 08 04:34:26.469839 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3ebfa41c-ae63-472e-9ff8-f44678c21031 req-93b35000-75f5-4e9f-87d4-84f83cd60af8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437601 Nov 08 04:34:27.584316 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f3c79e5-0d2d-4ec8-b2bd-2832e41c458c req-e31b4dd7-0809-4f2b-a9f7-0802ab4758cf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:27.585837 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f3c79e5-0d2d-4ec8-b2bd-2832e41c458c req-e31b4dd7-0809-4f2b-a9f7-0802ab4758cf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0504467 Nov 08 04:34:27.632241 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f3c79e5-0d2d-4ec8-b2bd-2832e41c458c req-40a9db20-758b-4722-a8e1-8bc752d0890f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403469 Nov 08 04:34:28.745410 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d3ec6b4-5398-4d3f-8f01-04fb9d721078 req-1231fd4f-e013-4860-83aa-89d3fdca0608 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:28.746867 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4d3ec6b4-5398-4d3f-8f01-04fb9d721078 req-1231fd4f-e013-4860-83aa-89d3fdca0608 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0480719 Nov 08 04:34:28.792052 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4d3ec6b4-5398-4d3f-8f01-04fb9d721078 req-b17b94e8-8d3f-4bcb-b8e4-7d9d0a35afdd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395174 Nov 08 04:34:29.907761 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-869ec3dc-671a-41f4-a068-3f148c76acfd req-2eec23f2-854e-4523-863a-f45b77160fb4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:29.909090 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-869ec3dc-671a-41f4-a068-3f148c76acfd req-2eec23f2-854e-4523-863a-f45b77160fb4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0505447 Nov 08 04:34:29.959585 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-869ec3dc-671a-41f4-a068-3f148c76acfd req-07580585-dd8b-4c09-9e01-f408b1372721 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441504 Nov 08 04:34:31.075403 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f6941c3-8582-4d48-8174-01eac1a9035c req-33a2f90e-666e-45e4-8de0-25002c36a8f9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:31.076848 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8f6941c3-8582-4d48-8174-01eac1a9035c req-33a2f90e-666e-45e4-8de0-25002c36a8f9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0478215 Nov 08 04:34:31.128159 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8f6941c3-8582-4d48-8174-01eac1a9035c req-ab7559e0-544a-415e-b847-f72465c0f14c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455856 Nov 08 04:34:32.243540 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1c8e876-9c0f-46c5-be0d-bc02d6b906e9 req-5b9c4fda-96c3-41ad-8a20-34db4713af7a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:32.244976 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d1c8e876-9c0f-46c5-be0d-bc02d6b906e9 req-5b9c4fda-96c3-41ad-8a20-34db4713af7a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0507429 Nov 08 04:34:32.290443 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d1c8e876-9c0f-46c5-be0d-bc02d6b906e9 req-2c0e0545-777c-4510-ba52-4abf61cf08d0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396757 Nov 08 04:34:33.403171 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad23cbf-0171-4554-a33b-598b0cd7ff37 req-7ed16fc8-ed67-4326-a04e-47e58d1d0829 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:33.404597 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aad23cbf-0171-4554-a33b-598b0cd7ff37 req-7ed16fc8-ed67-4326-a04e-47e58d1d0829 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0477972 Nov 08 04:34:33.449411 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aad23cbf-0171-4554-a33b-598b0cd7ff37 req-8dced23f-b966-4b02-9442-36d43d70ca8f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389585 Nov 08 04:34:34.563277 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf351a93-88dc-400d-b9e3-275a1cf3d327 req-8dd034d8-2ff5-42dd-a6be-b22e300b150e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:34.564699 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bf351a93-88dc-400d-b9e3-275a1cf3d327 req-8dd034d8-2ff5-42dd-a6be-b22e300b150e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0474081 Nov 08 04:34:34.615679 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bf351a93-88dc-400d-b9e3-275a1cf3d327 req-71ec4da4-f06a-49ab-8b36-bcc24aeae648 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452163 Nov 08 04:34:35.733374 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc155ccb-555f-4931-bc9d-1880c7b9fb69 req-93ad5c7f-a9ef-43e7-a8d4-d8de2e77ecbf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:35.734852 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bc155ccb-555f-4931-bc9d-1880c7b9fb69 req-93ad5c7f-a9ef-43e7-a8d4-d8de2e77ecbf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0528765 Nov 08 04:34:35.781703 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bc155ccb-555f-4931-bc9d-1880c7b9fb69 req-aed3bbdb-f0c3-43c1-b6d9-d5efdf329c7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404513 Nov 08 04:34:36.894980 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dce39fb-04cd-4a62-bdb6-e9706aa05e90 req-8bcb02e7-8587-4a19-9fcd-c1d66e0421b2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:36.896951 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2dce39fb-04cd-4a62-bdb6-e9706aa05e90 req-8bcb02e7-8587-4a19-9fcd-c1d66e0421b2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0476522 Nov 08 04:34:36.943529 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2dce39fb-04cd-4a62-bdb6-e9706aa05e90 req-0339e96c-9785-4a59-b777-b06f5021cd42 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406935 Nov 08 04:34:38.059133 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb6fad90-185c-420f-9c6e-e92725f880b2 req-b18f462c-c2b0-465f-8837-97edcf03c0b8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:38.060581 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb6fad90-185c-420f-9c6e-e92725f880b2 req-b18f462c-c2b0-465f-8837-97edcf03c0b8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0513728 Nov 08 04:34:38.106386 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb6fad90-185c-420f-9c6e-e92725f880b2 req-99d2902d-6d35-47f8-b483-f3d79a39edf4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400434 Nov 08 04:34:39.220192 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d99e786-01dd-4986-a4d5-8835a9c25703 req-96516f34-3beb-4996-9e57-d4fb4ea2dbc6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:39.221617 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5d99e786-01dd-4986-a4d5-8835a9c25703 req-96516f34-3beb-4996-9e57-d4fb4ea2dbc6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0476677 Nov 08 04:34:39.268444 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5d99e786-01dd-4986-a4d5-8835a9c25703 req-35a6b809-c1b7-4484-a3fa-aaf8b04f27a0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402718 Nov 08 04:34:40.381620 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2ea3f3-2865-4340-a533-122f12bb6da7 req-4bcd0700-5aea-4368-bb92-c8272677b92b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:40.383063 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac2ea3f3-2865-4340-a533-122f12bb6da7 req-4bcd0700-5aea-4368-bb92-c8272677b92b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0465872 Nov 08 04:34:40.431675 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac2ea3f3-2865-4340-a533-122f12bb6da7 req-f74da749-827d-4d73-a2be-89de9c239919 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428419 Nov 08 04:34:40.647947 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31019bd3-1675-4af6-b51a-e33273d05756 req-737778d6-60d8-4c28-89b3-0052c6223e2c service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0387404 Nov 08 04:34:40.744831 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31019bd3-1675-4af6-b51a-e33273d05756 req-a38a1754-7feb-43e9-a093-0e85dfe78910 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:40.746270 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31019bd3-1675-4af6-b51a-e33273d05756 req-a38a1754-7feb-43e9-a093-0e85dfe78910 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0391123 Nov 08 04:34:40.849408 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31019bd3-1675-4af6-b51a-e33273d05756 req-e48173dd-f66a-4c35-ae15-8672567fadce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:40.850767 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31019bd3-1675-4af6-b51a-e33273d05756 req-e48173dd-f66a-4c35-ae15-8672567fadce service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0844600 Nov 08 04:34:40.916113 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31019bd3-1675-4af6-b51a-e33273d05756 req-66dc0d14-82ce-4d15-9905-e85d31f500ee service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0572391 Nov 08 04:34:40.963303 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31019bd3-1675-4af6-b51a-e33273d05756 req-9f8ba6b1-6609-496f-a831-9ccdf3a9d248 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:40.964656 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31019bd3-1675-4af6-b51a-e33273d05756 req-9f8ba6b1-6609-496f-a831-9ccdf3a9d248 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0421166 Nov 08 04:34:41.011566 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31019bd3-1675-4af6-b51a-e33273d05756 req-3994e9ec-d000-48fa-b0fb-5198440bb4d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:41.012997 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31019bd3-1675-4af6-b51a-e33273d05756 req-3994e9ec-d000-48fa-b0fb-5198440bb4d5 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419166 Nov 08 04:34:41.098761 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31019bd3-1675-4af6-b51a-e33273d05756 req-b3d61162-d607-495e-9fcf-580de059daa1 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0785758 Nov 08 04:34:41.190807 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31019bd3-1675-4af6-b51a-e33273d05756 req-5500c8a3-c18e-485e-8c1d-fddd67d0b7d3 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844293 Nov 08 04:34:41.544930 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-283aec9d-cfa5-425d-a302-784ea50bd674 req-ce3bd501-1916-4c38-8c8e-98ff946a2d33 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:41.546357 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-283aec9d-cfa5-425d-a302-784ea50bd674 req-ce3bd501-1916-4c38-8c8e-98ff946a2d33 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0478947 Nov 08 04:34:41.591744 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-283aec9d-cfa5-425d-a302-784ea50bd674 req-6569e1b6-eb60-4f68-9af5-e5c094491b56 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395074 Nov 08 04:34:42.655428 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-89fa4fbf-38d2-4cd6-83f9-4c968a80f33e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:42.708175 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a421b78-023b-4464-b0ac-0fda0467e9c1 req-e6517d41-7fc7-465d-b31c-77bdd5513e0d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:42.709662 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3a421b78-023b-4464-b0ac-0fda0467e9c1 req-e6517d41-7fc7-465d-b31c-77bdd5513e0d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0511444 Nov 08 04:34:42.756325 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3a421b78-023b-4464-b0ac-0fda0467e9c1 req-a564f6de-05c6-4e99-ad6d-676d07ef437d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404003 Nov 08 04:34:43.868573 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1930b749-891c-4653-8991-9869ec43f9c7 req-ec3f8e1b-9e30-48e2-ab56-a158f7ba8a58 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:43.869916 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1930b749-891c-4653-8991-9869ec43f9c7 req-ec3f8e1b-9e30-48e2-ab56-a158f7ba8a58 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0472109 Nov 08 04:34:43.914865 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1930b749-891c-4653-8991-9869ec43f9c7 req-6ee760b3-fcd1-4870-ab52-ea24c2f7dadf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391715 Nov 08 04:34:45.028138 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed1ad73-8196-4808-acf2-e44fd0c0e278 req-5bfa6bd6-3b55-4686-9f68-0eac4e2ad570 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:45.029579 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ed1ad73-8196-4808-acf2-e44fd0c0e278 req-5bfa6bd6-3b55-4686-9f68-0eac4e2ad570 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0479517 Nov 08 04:34:45.078100 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ed1ad73-8196-4808-acf2-e44fd0c0e278 req-0d9c700e-0489-469b-99f8-62446050b7e1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424020 Nov 08 04:34:45.134906 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7251182b-fd01-425a-ba63-85a3d7882697 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:46.072418 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:46.192314 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ce4680-5dff-49d3-993a-45148f773226 req-86769b2d-a2bd-48c2-9308-379c94d0ef9d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:46.193769 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32ce4680-5dff-49d3-993a-45148f773226 req-86769b2d-a2bd-48c2-9308-379c94d0ef9d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0480888 Nov 08 04:34:46.239039 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32ce4680-5dff-49d3-993a-45148f773226 req-7b7c88df-006c-4faa-b9e6-e0b54761d52f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389173 Nov 08 04:34:47.358205 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50fc10cc-49c3-4d42-afce-4dcbc06bae66 req-869ac68a-02ef-4401-be33-59fd6604c100 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:47.359697 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-50fc10cc-49c3-4d42-afce-4dcbc06bae66 req-869ac68a-02ef-4401-be33-59fd6604c100 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0524447 Nov 08 04:34:47.404729 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-50fc10cc-49c3-4d42-afce-4dcbc06bae66 req-db73dc6d-7633-4593-872a-e25e3efb3580 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386298 Nov 08 04:34:47.712247 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:47.941381 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:34:48.386605 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:48.520627 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c39ad5-f616-453f-9dc2-9d2b62b775a6 req-234224b8-544c-4df4-ace4-a9ffc8942363 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:48.522061 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34c39ad5-f616-453f-9dc2-9d2b62b775a6 req-234224b8-544c-4df4-ace4-a9ffc8942363 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0510333 Nov 08 04:34:48.567511 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34c39ad5-f616-453f-9dc2-9d2b62b775a6 req-ed3d629a-fef2-4f99-9597-0d4abf0eefbe tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396814 Nov 08 04:34:49.682650 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d6a32c-a014-4bd3-969d-036173d2022c req-a4438081-0a6f-4888-9589-3f8179b2f1b2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:49.684098 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9d6a32c-a014-4bd3-969d-036173d2022c req-a4438081-0a6f-4888-9589-3f8179b2f1b2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0478234 Nov 08 04:34:49.730212 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9d6a32c-a014-4bd3-969d-036173d2022c req-e24d7289-4c11-49a1-9b87-9347233c9f6d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403194 Nov 08 04:34:50.844336 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-007465f9-17c7-4deb-ac2a-b5d583b632e9 req-7b635b4d-864e-4f02-b100-32a4617fc699 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:50.845696 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-007465f9-17c7-4deb-ac2a-b5d583b632e9 req-7b635b4d-864e-4f02-b100-32a4617fc699 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0477316 Nov 08 04:34:50.894722 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-007465f9-17c7-4deb-ac2a-b5d583b632e9 req-457185c4-1834-465c-a05b-6ca9e692594b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427022 Nov 08 04:34:52.007034 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9daf172-ee9a-482d-b672-67d749e941e1 req-356fea34-c9f7-4247-9fa2-3370aca1b2fe tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:52.008457 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b9daf172-ee9a-482d-b672-67d749e941e1 req-356fea34-c9f7-4247-9fa2-3370aca1b2fe tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0473731 Nov 08 04:34:52.053133 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b9daf172-ee9a-482d-b672-67d749e941e1 req-156915ed-3f8a-47f3-96c2-2368f1cf10db tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389850 Nov 08 04:34:53.164665 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a049ae63-0c90-4af5-a00f-fd1167ed59c9 req-34dc2956-f67e-4e55-9674-8ec0b7a6e28d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:53.166197 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a049ae63-0c90-4af5-a00f-fd1167ed59c9 req-34dc2956-f67e-4e55-9674-8ec0b7a6e28d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0475750 Nov 08 04:34:53.224034 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a049ae63-0c90-4af5-a00f-fd1167ed59c9 req-bb9f3c70-1575-461b-9332-795773c73a23 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493569 Nov 08 04:34:54.339747 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8803f7f8-e203-4787-b388-30f2cb7bddb2 req-a0f7c2a7-6898-4789-aebf-15f063c82c35 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:54.341220 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8803f7f8-e203-4787-b388-30f2cb7bddb2 req-a0f7c2a7-6898-4789-aebf-15f063c82c35 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0517392 Nov 08 04:34:54.387502 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8803f7f8-e203-4787-b388-30f2cb7bddb2 req-b121f2ba-d406-4b58-9940-b8fd6477c28a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404305 Nov 08 04:34:54.398002 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:34:55.505366 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee2ed76-4979-4781-a810-7a152dc1750d req-4546392a-5b53-41c0-915a-fa2fd56d3fd4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:55.509417 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1ee2ed76-4979-4781-a810-7a152dc1750d req-4546392a-5b53-41c0-915a-fa2fd56d3fd4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0475793 Nov 08 04:34:55.554017 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1ee2ed76-4979-4781-a810-7a152dc1750d req-add0f750-dcee-487f-9b55-2be63fac6658 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402582 Nov 08 04:34:56.669483 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-212d4574-7574-415c-a597-58ae84e603e6 req-01a6b7bc-9301-4dab-a6a5-b062de531df2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:56.670938 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-212d4574-7574-415c-a597-58ae84e603e6 req-01a6b7bc-9301-4dab-a6a5-b062de531df2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0502748 Nov 08 04:34:56.716369 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-212d4574-7574-415c-a597-58ae84e603e6 req-f4a60c59-14ad-4162-a6cb-3be43f991ab4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390551 Nov 08 04:34:57.828463 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f59502a-fb4b-4cb1-b709-833624d503cb req-1c0ec808-6a92-440b-ba5d-d2bff8b0e237 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:57.829884 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9f59502a-fb4b-4cb1-b709-833624d503cb req-1c0ec808-6a92-440b-ba5d-d2bff8b0e237 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0472109 Nov 08 04:34:57.876240 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9f59502a-fb4b-4cb1-b709-833624d503cb req-cf3ca522-7c83-4f62-ae75-eed02b590364 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397060 Nov 08 04:34:58.992351 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db75a3b-78ad-4a9a-bf36-29ea75aaeb59 req-cf249635-fd40-467d-89de-07a61798cf62 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:34:58.993775 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9db75a3b-78ad-4a9a-bf36-29ea75aaeb59 req-cf249635-fd40-467d-89de-07a61798cf62 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0468097 Nov 08 04:34:59.042054 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9db75a3b-78ad-4a9a-bf36-29ea75aaeb59 req-54013a8c-c0d7-4bbf-a293-d6e2dc5f3e17 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425649 Nov 08 04:35:00.154368 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3dab6b-147c-44bb-a421-5e71e53ace7b req-4cb0851c-04af-42ec-b1ea-0e7564341bfa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:00.155801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bd3dab6b-147c-44bb-a421-5e71e53ace7b req-4cb0851c-04af-42ec-b1ea-0e7564341bfa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0469806 Nov 08 04:35:00.200436 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bd3dab6b-147c-44bb-a421-5e71e53ace7b req-7103628b-a9cf-422d-a5c1-4187e2003e40 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388885 Nov 08 04:35:01.311928 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7d20ac9-eafb-4240-98f1-50fccc572229 req-9dc463ba-8d98-49f4-9a31-013f71fe50e4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:01.313370 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f7d20ac9-eafb-4240-98f1-50fccc572229 req-9dc463ba-8d98-49f4-9a31-013f71fe50e4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0472846 Nov 08 04:35:01.358878 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f7d20ac9-eafb-4240-98f1-50fccc572229 req-914270aa-b8f3-406e-8a09-0889b4f46a48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391498 Nov 08 04:35:02.477558 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267cfbd3-5646-4c57-be8f-db79a01a48dd req-32d2628c-2b63-4872-8253-eda469ccb29b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:02.479038 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-267cfbd3-5646-4c57-be8f-db79a01a48dd req-32d2628c-2b63-4872-8253-eda469ccb29b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0513065 Nov 08 04:35:02.525767 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-267cfbd3-5646-4c57-be8f-db79a01a48dd req-90a52c5a-735d-4319-996d-a335fab712b7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407233 Nov 08 04:35:03.641627 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b4b2418-16c3-40c7-8f47-8f60889889e3 req-f7bba9fb-11a4-4e2d-b222-28b8572cd6f1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:03.643106 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6b4b2418-16c3-40c7-8f47-8f60889889e3 req-f7bba9fb-11a4-4e2d-b222-28b8572cd6f1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0478556 Nov 08 04:35:03.689014 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6b4b2418-16c3-40c7-8f47-8f60889889e3 req-1d88c3fe-ffce-412f-b52c-77abf57606d9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399127 Nov 08 04:35:04.801963 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f3cb32-8080-4521-9af8-2dc6711d15df req-0681072f-d544-44c1-891c-5fe07baa5a58 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:04.803440 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5f3cb32-8080-4521-9af8-2dc6711d15df req-0681072f-d544-44c1-891c-5fe07baa5a58 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0485523 Nov 08 04:35:04.853762 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5f3cb32-8080-4521-9af8-2dc6711d15df req-0e81e31c-ea26-4833-8236-58adf9f1036b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444901 Nov 08 04:35:05.966248 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a24f887-7eb8-4991-a2dc-a411b5775e6e req-82a23338-ef5b-40e7-b49e-0745582216e9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:05.967874 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a24f887-7eb8-4991-a2dc-a411b5775e6e req-82a23338-ef5b-40e7-b49e-0745582216e9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0480802 Nov 08 04:35:06.014188 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a24f887-7eb8-4991-a2dc-a411b5775e6e req-d28ca83d-82f1-42f7-ac9b-f94611eeaaf0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398362 Nov 08 04:35:07.131394 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-985884df-d949-498a-bdd6-ca7e7443a4d8 req-d981f4eb-a8c8-414b-96d5-7b05415d8086 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:07.132825 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-985884df-d949-498a-bdd6-ca7e7443a4d8 req-d981f4eb-a8c8-414b-96d5-7b05415d8086 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0482481 Nov 08 04:35:07.178217 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-985884df-d949-498a-bdd6-ca7e7443a4d8 req-2c35407b-4e92-4257-ae9a-35b15f0dce65 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396833 Nov 08 04:35:08.319772 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c3ea47-96ce-4e54-a790-ec55950369eb req-f4e3305d-69d3-4c1a-95a0-dd53c35cbc3f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:08.321241 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a9c3ea47-96ce-4e54-a790-ec55950369eb req-f4e3305d-69d3-4c1a-95a0-dd53c35cbc3f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0508895 Nov 08 04:35:08.368135 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a9c3ea47-96ce-4e54-a790-ec55950369eb req-1705806c-a976-435e-894a-2ccd367092f0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409486 Nov 08 04:35:09.481044 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf7eb8a-77e6-4115-9a3b-37e26c4c30b5 req-3852446d-7614-4681-aad1-053d3babb7d1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:09.482468 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bdf7eb8a-77e6-4115-9a3b-37e26c4c30b5 req-3852446d-7614-4681-aad1-053d3babb7d1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0474615 Nov 08 04:35:09.534757 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bdf7eb8a-77e6-4115-9a3b-37e26c4c30b5 req-1df08a4f-aab6-4c45-a06c-673e1a16abe0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457828 Nov 08 04:35:10.652244 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3f3347-4f57-4947-9932-fd74a2c997d8 req-20a42c9e-7914-466b-b6aa-f5015a1ce341 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:10.653723 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f3f3347-4f57-4947-9932-fd74a2c997d8 req-20a42c9e-7914-466b-b6aa-f5015a1ce341 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0513732 Nov 08 04:35:10.699969 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f3f3347-4f57-4947-9932-fd74a2c997d8 req-9ff6e5c0-b98d-44a2-aa61-21c63af53a4a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399215 Nov 08 04:35:11.810918 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90adc4a5-6c49-4d52-a435-f37de7852ec6 req-5cfd21da-d290-4a6e-b9a4-dae867356122 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:11.812304 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-90adc4a5-6c49-4d52-a435-f37de7852ec6 req-5cfd21da-d290-4a6e-b9a4-dae867356122 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0465271 Nov 08 04:35:11.857751 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-90adc4a5-6c49-4d52-a435-f37de7852ec6 req-cd1bd4f7-5fcd-40df-9162-81632a7d4b15 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390599 Nov 08 04:35:12.711608 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c5165f3c-a6b1-4a8c-9838-494181b8744a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:12.969574 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d1990f-32ae-46dc-93ba-a9f3a59ffb88 req-db857187-7cb5-4be6-a0de-4b978757c92d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:12.971027 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d5d1990f-32ae-46dc-93ba-a9f3a59ffb88 req-db857187-7cb5-4be6-a0de-4b978757c92d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0476294 Nov 08 04:35:13.020780 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d5d1990f-32ae-46dc-93ba-a9f3a59ffb88 req-8c69212e-d70b-4b22-918d-2851454b8a26 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422835 Nov 08 04:35:14.132839 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0a19f65-1a11-411f-b29d-1641d4bba771 req-6a833f63-4ade-42ba-81ff-6638299d9156 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:14.134254 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c0a19f65-1a11-411f-b29d-1641d4bba771 req-6a833f63-4ade-42ba-81ff-6638299d9156 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0468864 Nov 08 04:35:14.179313 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c0a19f65-1a11-411f-b29d-1641d4bba771 req-5c304560-18e8-48df-a532-405eb2eccd35 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393507 Nov 08 04:35:14.992849 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [req-fef2465d-6898-4a84-b947-51e4d1470361 req-427cc091-361e-405b-ba6e-9663aa5df225 service neutron] (101664) timed out ('10.222.0.21', 54634) {{(pid=101664) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 08 04:35:15.157146 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3b77fdad-b666-4019-80a8-39a020e8d3b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:15.300427 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d42f3f-458c-4ff0-b9c4-95a166bc7f78 req-ada00b17-7bd5-44cd-b046-7de9cab956fd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:15.301875 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-97d42f3f-458c-4ff0-b9c4-95a166bc7f78 req-ada00b17-7bd5-44cd-b046-7de9cab956fd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0498226 Nov 08 04:35:15.346747 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-97d42f3f-458c-4ff0-b9c4-95a166bc7f78 req-157184bc-e113-4eb6-9aa9-aab491d51931 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390201 Nov 08 04:35:16.066157 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:16.462584 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed7af62-efc3-4401-84d5-2f6ea933753c req-0767f6a5-b716-4b6e-8827-9259d0123f12 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:16.464035 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aed7af62-efc3-4401-84d5-2f6ea933753c req-0767f6a5-b716-4b6e-8827-9259d0123f12 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0507586 Nov 08 04:35:16.508761 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aed7af62-efc3-4401-84d5-2f6ea933753c req-c1503221-b614-47e6-8a09-96ab9c72b132 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389538 Nov 08 04:35:17.621918 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a43d9a2-1ec1-41af-8298-a1266a1fab4b req-44727d09-8456-41a6-804d-6ee3b17a9cf8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:17.623389 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a43d9a2-1ec1-41af-8298-a1266a1fab4b req-44727d09-8456-41a6-804d-6ee3b17a9cf8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0484774 Nov 08 04:35:17.669675 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a43d9a2-1ec1-41af-8298-a1266a1fab4b req-20cc20b2-b7db-4751-b656-a53395338fda tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397985 Nov 08 04:35:17.694261 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:18.385638 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:18.782294 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a9604db-be7d-4e2d-813d-e3218be484d8 req-8a4a0a45-05d3-4bb9-adc4-a093a6069385 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:18.784247 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4a9604db-be7d-4e2d-813d-e3218be484d8 req-8a4a0a45-05d3-4bb9-adc4-a093a6069385 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0467584 Nov 08 04:35:18.832342 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4a9604db-be7d-4e2d-813d-e3218be484d8 req-fdbef032-82ff-4048-a964-df2815cfa4d0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423210 Nov 08 04:35:19.944744 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e240935d-6f69-4a0d-b59e-72ac81a53901 req-a70fba65-a763-4eb6-a697-8d497da3c8da tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:19.946160 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e240935d-6f69-4a0d-b59e-72ac81a53901 req-a70fba65-a763-4eb6-a697-8d497da3c8da tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0466247 Nov 08 04:35:19.991667 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e240935d-6f69-4a0d-b59e-72ac81a53901 req-dff0dccd-dbda-45d3-84cf-7971e99bf0fd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396423 Nov 08 04:35:21.103498 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c384ed-168b-4f8c-ac38-cfc888742464 req-d9921f9d-d04f-42a3-a545-f36ae9d4bafd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:21.104940 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-66c384ed-168b-4f8c-ac38-cfc888742464 req-d9921f9d-d04f-42a3-a545-f36ae9d4bafd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0480530 Nov 08 04:35:21.150118 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-66c384ed-168b-4f8c-ac38-cfc888742464 req-0d020051-519f-4228-b105-4497271b5db6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392787 Nov 08 04:35:22.268752 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14089012-12f2-4c10-a134-7efe810d631e req-962cf699-9f59-4bc7-8c7e-bb9f94b0d64c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:22.270173 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-14089012-12f2-4c10-a134-7efe810d631e req-962cf699-9f59-4bc7-8c7e-bb9f94b0d64c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0502982 Nov 08 04:35:22.315868 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-14089012-12f2-4c10-a134-7efe810d631e req-90079975-4e19-4d29-a8ac-b4b9cc1154b6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399122 Nov 08 04:35:23.426946 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c3906d-36a1-4856-99cf-4a94b3a3935f req-8629844e-a526-4a99-80f0-07111c9af27a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:23.428365 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6c3906d-36a1-4856-99cf-4a94b3a3935f req-8629844e-a526-4a99-80f0-07111c9af27a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0471623 Nov 08 04:35:23.474217 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6c3906d-36a1-4856-99cf-4a94b3a3935f req-c74e0a15-7c9d-4849-91ca-b36c8759967c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401750 Nov 08 04:35:24.408153 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:24.591879 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf767cd-20c1-474a-874e-c66462260650 req-144f526e-38bb-46b6-8994-d02b66c57514 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:24.593358 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4bf767cd-20c1-474a-874e-c66462260650 req-144f526e-38bb-46b6-8994-d02b66c57514 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0510151 Nov 08 04:35:24.639939 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4bf767cd-20c1-474a-874e-c66462260650 req-ed917a5c-8fcb-4053-a5d7-2527b502a7a3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397105 Nov 08 04:35:24.939993 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:35:25.752150 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d076fe-153c-48ac-b9f4-b1045a0bd06a req-5d5ce318-2814-429f-a57d-96082e421d38 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:25.754220 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65d076fe-153c-48ac-b9f4-b1045a0bd06a req-5d5ce318-2814-429f-a57d-96082e421d38 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0473361 Nov 08 04:35:25.798265 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-65d076fe-153c-48ac-b9f4-b1045a0bd06a req-da759160-911c-4adc-80ba-4e65c70444c9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383260 Nov 08 04:35:26.912073 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f977c5d-561e-4473-9685-198c73c40097 req-59852e00-d28a-498a-95c9-79197b6a6e83 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:26.913437 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0f977c5d-561e-4473-9685-198c73c40097 req-59852e00-d28a-498a-95c9-79197b6a6e83 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0478268 Nov 08 04:35:26.962806 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0f977c5d-561e-4473-9685-198c73c40097 req-072fd2f0-369a-4cd5-8ee2-2f8f98173af9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434551 Nov 08 04:35:28.078259 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42fedc11-7cbf-4a31-96fa-eba5274cd170 req-b2fb7b84-913c-49a2-8ef5-e4c3262c4ac3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:28.079697 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-42fedc11-7cbf-4a31-96fa-eba5274cd170 req-b2fb7b84-913c-49a2-8ef5-e4c3262c4ac3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0494380 Nov 08 04:35:28.124749 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-42fedc11-7cbf-4a31-96fa-eba5274cd170 req-ec2ae55c-eb37-4c8a-a02b-40507e5374e6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390000 Nov 08 04:35:29.244583 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3361f6da-ee85-4be4-880c-1646c8d854bd req-ce7a5122-41d7-43e4-aafa-5273618a0e80 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:29.246061 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3361f6da-ee85-4be4-880c-1646c8d854bd req-ce7a5122-41d7-43e4-aafa-5273618a0e80 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0482273 Nov 08 04:35:29.291645 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3361f6da-ee85-4be4-880c-1646c8d854bd req-22818afc-203f-4889-bfa6-24997230c6db tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397849 Nov 08 04:35:30.411709 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c627b2cb-8a55-4971-b016-9396c609f3c5 req-4648d0b8-9bf9-4a30-adc4-7495e3e4cf5e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:30.413146 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c627b2cb-8a55-4971-b016-9396c609f3c5 req-4648d0b8-9bf9-4a30-adc4-7495e3e4cf5e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0511401 Nov 08 04:35:30.457738 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c627b2cb-8a55-4971-b016-9396c609f3c5 req-64e163a5-7632-4a94-9cf6-29fc1e32edc7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387287 Nov 08 04:35:31.569926 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ef9201-33d1-4247-8e8a-462bee6ae231 req-35d63dbb-5a6c-4dc4-86ce-1cf3b85aad07 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:31.571363 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00ef9201-33d1-4247-8e8a-462bee6ae231 req-35d63dbb-5a6c-4dc4-86ce-1cf3b85aad07 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0475841 Nov 08 04:35:31.617208 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00ef9201-33d1-4247-8e8a-462bee6ae231 req-3f7257ad-b404-4d3d-ab6e-7e5dc6520da2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400589 Nov 08 04:35:32.727916 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca71f1d-b45c-4d43-bab7-82afe42ca25c req-26d8acd3-b219-40a2-a802-cc337d61c950 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:32.729357 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4ca71f1d-b45c-4d43-bab7-82afe42ca25c req-26d8acd3-b219-40a2-a802-cc337d61c950 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0470893 Nov 08 04:35:32.778242 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4ca71f1d-b45c-4d43-bab7-82afe42ca25c req-364ecdc5-74fc-4388-8796-98c1d4f73d6b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429549 Nov 08 04:35:33.891511 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee931a4-a46a-48d0-b452-e8d0f0bc12ba req-9a6e63ae-9393-492b-bd18-0769568db12d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:33.892902 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3ee931a4-a46a-48d0-b452-e8d0f0bc12ba req-9a6e63ae-9393-492b-bd18-0769568db12d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0482509 Nov 08 04:35:33.938666 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3ee931a4-a46a-48d0-b452-e8d0f0bc12ba req-e390ba4a-69f1-408e-90c3-e2e736ad6de9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393806 Nov 08 04:35:35.053174 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e318e461-c8e7-4a2d-9839-8799970bbcd5 req-99150ede-f117-4275-a0ba-3110a3cbe474 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:35.054615 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e318e461-c8e7-4a2d-9839-8799970bbcd5 req-99150ede-f117-4275-a0ba-3110a3cbe474 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0469477 Nov 08 04:35:35.099296 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e318e461-c8e7-4a2d-9839-8799970bbcd5 req-638c057a-4469-447e-8274-08b78a4a1a62 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389066 Nov 08 04:35:36.214438 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d56f94c7-4087-41b3-b57c-76f94f2efa60 req-d04eda8d-11a9-41d5-bb91-cf5b033ff23e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:36.215902 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d56f94c7-4087-41b3-b57c-76f94f2efa60 req-d04eda8d-11a9-41d5-bb91-cf5b033ff23e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0509565 Nov 08 04:35:36.261728 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d56f94c7-4087-41b3-b57c-76f94f2efa60 req-a8031fbc-5de3-4e0f-b69e-687af76aad80 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400586 Nov 08 04:35:37.375849 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07d997a8-542e-4931-901c-b5b6d6a2e5ef req-21511eb1-bb5b-4de9-a24c-fb44d2675b94 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:37.377632 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-07d997a8-542e-4931-901c-b5b6d6a2e5ef req-21511eb1-bb5b-4de9-a24c-fb44d2675b94 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0491953 Nov 08 04:35:37.428527 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-07d997a8-542e-4931-901c-b5b6d6a2e5ef req-fed33827-a4c1-4a55-9339-67cc3940e765 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443168 Nov 08 04:35:38.555779 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ab689c-80b3-4695-ab61-3a8a15975bcd req-a685e216-298a-4b5f-ac80-0aacae394ce7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:38.557252 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-15ab689c-80b3-4695-ab61-3a8a15975bcd req-a685e216-298a-4b5f-ac80-0aacae394ce7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0610073 Nov 08 04:35:38.604766 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-15ab689c-80b3-4695-ab61-3a8a15975bcd req-cfb92dd7-ef5d-4cab-89c7-b1c669ec9e9f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413837 Nov 08 04:35:39.717294 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b308674-dc77-40ab-814c-6c9001508c64 req-9538e08d-6951-4956-a8a2-cc9cfd0ab8cd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:39.718661 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6b308674-dc77-40ab-814c-6c9001508c64 req-9538e08d-6951-4956-a8a2-cc9cfd0ab8cd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0474889 Nov 08 04:35:39.762880 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6b308674-dc77-40ab-814c-6c9001508c64 req-91b2f4f8-49f7-4655-80c8-cc05e215b0bc tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384581 Nov 08 04:35:40.874476 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e194865e-3fa3-4df3-864f-5be61814f20a req-4eeaa170-07d2-4988-9016-d40d92a4fd4e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:40.875927 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e194865e-3fa3-4df3-864f-5be61814f20a req-4eeaa170-07d2-4988-9016-d40d92a4fd4e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0466692 Nov 08 04:35:40.923511 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e194865e-3fa3-4df3-864f-5be61814f20a req-3fa134da-509b-416e-aa34-734e1d98ad0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412669 Nov 08 04:35:42.034898 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d161f1-374b-4671-ae69-267204e879bc req-2fe3ff14-05d5-4107-bc88-a651266f27cf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:42.036794 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7d161f1-374b-4671-ae69-267204e879bc req-2fe3ff14-05d5-4107-bc88-a651266f27cf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0463889 Nov 08 04:35:42.081362 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b7d161f1-374b-4671-ae69-267204e879bc req-5c9adf91-8c07-4b58-8720-bc9a9822c261 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388656 Nov 08 04:35:42.645166 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-e5522615-03a7-4fb6-ad12-7118f397b6d1 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0375185 Nov 08 04:35:42.659437 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cfab5ae8-20f6-4fe5-bf7d-8601be10fb5a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:42.740841 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-67eafde5-f52f-4bd7-ba68-cfce74d36b4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:42.742278 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-67eafde5-f52f-4bd7-ba68-cfce74d36b4d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0397263 Nov 08 04:35:42.843820 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-b9285b67-c4a1-4976-a8c9-9aea95365693 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:42.845276 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-b9285b67-c4a1-4976-a8c9-9aea95365693 service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0848534 Nov 08 04:35:42.910884 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-d94c09fa-a2d7-454a-803a-b2b3331e576e service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0581238 Nov 08 04:35:43.248400 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-97c1aa5f-2645-4ac0-bf75-1023ca786bb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:43.249808 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-97c1aa5f-2645-4ac0-bf75-1023ca786bb0 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.3314633 Nov 08 04:35:43.272512 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2490452-ff24-4327-92a4-acece1b4196a req-ea1928b3-c69c-4386-aa33-a0c325b437d4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:43.273857 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f2490452-ff24-4327-92a4-acece1b4196a req-ea1928b3-c69c-4386-aa33-a0c325b437d4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0669873 Nov 08 04:35:43.341633 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-4c114e1d-a987-472f-bccd-d103821f0f26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:43.343181 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-4c114e1d-a987-472f-bccd-d103821f0f26 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0861118 Nov 08 04:35:43.348179 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f2490452-ff24-4327-92a4-acece1b4196a req-2ff28417-20ed-4170-9d14-5cd5c2a5796a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604670 Nov 08 04:35:43.429457 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-b67ed332-4a35-4298-93f6-e9ff82660039 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788121 Nov 08 04:35:43.518094 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5c34283-8f00-4faa-ac09-12cc0c043193 req-dfa5b986-6aea-4d96-af62-355b12562153 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817339 Nov 08 04:35:44.461606 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1bc8df0-d6f9-4ed2-860d-70be3b983436 req-fc9e11ea-6040-4f81-afda-c850f24034b6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:44.463109 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1bc8df0-d6f9-4ed2-860d-70be3b983436 req-fc9e11ea-6040-4f81-afda-c850f24034b6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0485165 Nov 08 04:35:44.511666 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1bc8df0-d6f9-4ed2-860d-70be3b983436 req-d43e59a6-47cd-4125-8a2b-100a23339e2e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427647 Nov 08 04:35:45.144334 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-06eed307-e0ee-4d28-b501-787d28a51748 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:45.629406 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a69d9890-8afb-4d22-ab2f-47ba6af4d1d4 req-77099dfd-6299-4e88-9b62-999e2d863730 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:45.630895 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a69d9890-8afb-4d22-ab2f-47ba6af4d1d4 req-77099dfd-6299-4e88-9b62-999e2d863730 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0497899 Nov 08 04:35:45.679045 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a69d9890-8afb-4d22-ab2f-47ba6af4d1d4 req-e60d87f2-4ff6-4a78-9ddf-165cbdb81cf1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423729 Nov 08 04:35:46.058984 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:46.791544 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92defc71-96d3-4419-b26f-1fe8021d0b92 req-eeec2678-925c-4666-a49e-48b86f72e0e9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:46.792985 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92defc71-96d3-4419-b26f-1fe8021d0b92 req-eeec2678-925c-4666-a49e-48b86f72e0e9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0471833 Nov 08 04:35:46.838352 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92defc71-96d3-4419-b26f-1fe8021d0b92 req-51f6447f-bcea-43f9-bb40-aa66ed2c1ea2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395105 Nov 08 04:35:47.721737 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:47.949938 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaa34dde-7960-4125-812b-ce0c96b6bfaa req-0925112c-5cd9-4999-9861-b1c2de6b5078 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:47.951458 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eaa34dde-7960-4125-812b-ce0c96b6bfaa req-0925112c-5cd9-4999-9861-b1c2de6b5078 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0470374 Nov 08 04:35:47.996500 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eaa34dde-7960-4125-812b-ce0c96b6bfaa req-1e1f913a-b993-4b33-bb0a-28adb3297d8d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393200 Nov 08 04:35:48.407368 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:49.111516 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f785385-e53f-49a9-b120-cffb38e9cf9b req-d5e27579-3c8d-48c7-9c6c-6b1f2d044bfa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:49.112953 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8f785385-e53f-49a9-b120-cffb38e9cf9b req-d5e27579-3c8d-48c7-9c6c-6b1f2d044bfa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0507269 Nov 08 04:35:49.157464 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8f785385-e53f-49a9-b120-cffb38e9cf9b req-3fe553c2-150c-410d-afb8-92a89d0676a9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387609 Nov 08 04:35:50.270181 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91d5a78c-78a4-4614-9528-2e28330353bb req-00074c54-6578-4252-be9c-413f4b4d5cc3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:50.271619 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91d5a78c-78a4-4614-9528-2e28330353bb req-00074c54-6578-4252-be9c-413f4b4d5cc3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0468650 Nov 08 04:35:50.315346 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91d5a78c-78a4-4614-9528-2e28330353bb req-496eea91-267d-4bb5-8fb3-b942547fed01 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380189 Nov 08 04:35:51.434091 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d100cc0-4691-411a-85b7-151dd7d0d461 req-df933fb8-6a8d-4664-98d6-8ca77e55f0da tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:51.435545 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6d100cc0-4691-411a-85b7-151dd7d0d461 req-df933fb8-6a8d-4664-98d6-8ca77e55f0da tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0466571 Nov 08 04:35:51.483559 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6d100cc0-4691-411a-85b7-151dd7d0d461 req-e747ce0a-22ba-4d37-b110-cd9e4c972066 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422151 Nov 08 04:35:52.596673 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a32315-5f83-41a5-96bd-95b4e21f701d req-efeffd87-49e7-437c-839c-a3bb653b35fb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:52.598820 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f0a32315-5f83-41a5-96bd-95b4e21f701d req-efeffd87-49e7-437c-839c-a3bb653b35fb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0484793 Nov 08 04:35:52.644726 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f0a32315-5f83-41a5-96bd-95b4e21f701d req-04849b2a-d23a-4cdf-9075-c5ad675ea65d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394797 Nov 08 04:35:53.758819 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ee8bc5-e8a5-4620-8f63-b6dc87f87ebd req-d5ab2e61-5c10-4181-9e50-7df72bcedcec tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:53.760275 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d0ee8bc5-e8a5-4620-8f63-b6dc87f87ebd req-d5ab2e61-5c10-4181-9e50-7df72bcedcec tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0478599 Nov 08 04:35:53.807148 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d0ee8bc5-e8a5-4620-8f63-b6dc87f87ebd req-df8498eb-dd85-4e8f-ad1f-0eb672d437f5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410721 Nov 08 04:35:54.435691 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:35:54.922459 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e26fb4b-9f55-41a5-8b99-fa7107d3322d req-4d24ce4b-4555-4f5a-9e80-e9dd13034a63 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:54.923922 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8e26fb4b-9f55-41a5-8b99-fa7107d3322d req-4d24ce4b-4555-4f5a-9e80-e9dd13034a63 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0505853 Nov 08 04:35:54.969528 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8e26fb4b-9f55-41a5-8b99-fa7107d3322d req-b6f8593f-6aa5-4407-addb-3da9256c4528 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393233 Nov 08 04:35:56.080987 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96c86d7-a065-4779-b97d-c3834bc78a7d req-eee0dde3-4e96-4a70-9130-40df4fa02f76 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:56.082401 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c96c86d7-a065-4779-b97d-c3834bc78a7d req-eee0dde3-4e96-4a70-9130-40df4fa02f76 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0471909 Nov 08 04:35:56.127875 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c96c86d7-a065-4779-b97d-c3834bc78a7d req-cced4355-0329-4a54-b55c-fd8bddea792e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393481 Nov 08 04:35:57.242987 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbff40a4-8866-46b1-9db4-26edf3c9bcc8 req-8e1c942a-5022-4c99-b351-6b7ce6414523 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:57.244454 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbff40a4-8866-46b1-9db4-26edf3c9bcc8 req-8e1c942a-5022-4c99-b351-6b7ce6414523 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0504093 Nov 08 04:35:57.288998 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbff40a4-8866-46b1-9db4-26edf3c9bcc8 req-a9fb216d-07ef-4bba-af75-f7d136a56712 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387719 Nov 08 04:35:58.400965 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd8002a-1dab-495e-8bb1-af93d1ce3f46 req-a1c9fbde-9e87-4509-a55b-7006db843cc9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:58.402408 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5fd8002a-1dab-495e-8bb1-af93d1ce3f46 req-a1c9fbde-9e87-4509-a55b-7006db843cc9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0477011 Nov 08 04:35:58.447967 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5fd8002a-1dab-495e-8bb1-af93d1ce3f46 req-c168d8bd-7ae4-475b-bccc-475c5b5b0f6f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396659 Nov 08 04:35:59.560866 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26bddca-c535-46a5-89e0-ea77345c1828 req-c37c4e3d-6d09-4f7a-a7ed-67407ad1f533 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:35:59.562310 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d26bddca-c535-46a5-89e0-ea77345c1828 req-c37c4e3d-6d09-4f7a-a7ed-67407ad1f533 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0482826 Nov 08 04:35:59.611332 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d26bddca-c535-46a5-89e0-ea77345c1828 req-be3bced6-4f8c-4955-b51f-e74c1fe22eb7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425022 Nov 08 04:36:00.724859 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7121aaba-128a-43c7-879b-972564b3fb64 req-9bfd463a-d516-42cf-86f9-25001d9ae723 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:00.726346 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7121aaba-128a-43c7-879b-972564b3fb64 req-9bfd463a-d516-42cf-86f9-25001d9ae723 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0481656 Nov 08 04:36:00.771866 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7121aaba-128a-43c7-879b-972564b3fb64 req-8a95ed81-51eb-48e6-a0dd-78690b2121a4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396888 Nov 08 04:36:01.886420 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8722903a-4a5f-4970-aebd-5b1b0887d9ef req-02a98d58-e314-438f-9558-28b32837e27f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:01.887792 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8722903a-4a5f-4970-aebd-5b1b0887d9ef req-02a98d58-e314-438f-9558-28b32837e27f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0475247 Nov 08 04:36:01.932756 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8722903a-4a5f-4970-aebd-5b1b0887d9ef req-acf77745-7f15-4336-8e0b-63068478bdae tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392754 Nov 08 04:36:01.938338 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:36:03.048892 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7a98957-2559-4e4e-926c-6c0bcc81c67f req-8788901d-17ff-4946-97c7-7c82f254442a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:03.050331 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d7a98957-2559-4e4e-926c-6c0bcc81c67f req-8788901d-17ff-4946-97c7-7c82f254442a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0509312 Nov 08 04:36:03.097266 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d7a98957-2559-4e4e-926c-6c0bcc81c67f req-ed6e5171-3cfd-4dd5-9985-7f279e39b2a8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402808 Nov 08 04:36:04.224064 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb3eab68-6345-4c4c-b63e-e66673da424a req-425a43b3-6cd5-430f-851b-300c7ec99a89 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:04.225854 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb3eab68-6345-4c4c-b63e-e66673da424a req-425a43b3-6cd5-430f-851b-300c7ec99a89 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0599442 Nov 08 04:36:04.275248 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb3eab68-6345-4c4c-b63e-e66673da424a req-4e69c3b8-9ee8-4c36-8c48-856c83b9c684 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435545 Nov 08 04:36:05.389481 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-989f8cb1-2cf7-43f7-9574-b384b91b29df req-dd082b59-2183-4ca1-8544-f7c4054480a7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:05.390949 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-989f8cb1-2cf7-43f7-9574-b384b91b29df req-dd082b59-2183-4ca1-8544-f7c4054480a7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0471673 Nov 08 04:36:05.443435 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-989f8cb1-2cf7-43f7-9574-b384b91b29df req-6a4191cf-20f2-4fe4-b4b3-064b8227da56 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442677 Nov 08 04:36:06.557037 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e6df39f-96b6-49cc-8c77-01abeeda9a60 req-4e987e06-707c-49ba-8d02-3dca84dd6991 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:06.558473 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0e6df39f-96b6-49cc-8c77-01abeeda9a60 req-4e987e06-707c-49ba-8d02-3dca84dd6991 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0473118 Nov 08 04:36:06.604146 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0e6df39f-96b6-49cc-8c77-01abeeda9a60 req-ad8609bb-af90-4f99-98ab-a74857fe17d7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398984 Nov 08 04:36:07.717792 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56279a47-e3f0-4d3c-940f-9fd916d7d761 req-76c8b257-03eb-45ce-9778-9d8dba808e00 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:07.719250 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-56279a47-e3f0-4d3c-940f-9fd916d7d761 req-76c8b257-03eb-45ce-9778-9d8dba808e00 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0469801 Nov 08 04:36:07.763859 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-56279a47-e3f0-4d3c-940f-9fd916d7d761 req-9e71fa34-79d3-4ce9-91de-29017c289462 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382056 Nov 08 04:36:08.880041 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d597be95-f174-44f4-9fc8-c76a05a14797 req-d596e99b-973b-455f-8417-fb8513e88483 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:08.881388 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d597be95-f174-44f4-9fc8-c76a05a14797 req-d596e99b-973b-455f-8417-fb8513e88483 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0511661 Nov 08 04:36:08.926899 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d597be95-f174-44f4-9fc8-c76a05a14797 req-ee8fc208-80be-484b-8587-8644b4cbfc49 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391114 Nov 08 04:36:10.037049 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b777ff0-1abb-4436-a452-d01c22f84f68 req-779045a5-9027-47c4-b9b6-6d7be9ebc057 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:10.038504 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b777ff0-1abb-4436-a452-d01c22f84f68 req-779045a5-9027-47c4-b9b6-6d7be9ebc057 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0469348 Nov 08 04:36:10.084143 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b777ff0-1abb-4436-a452-d01c22f84f68 req-23388064-5337-40d6-8151-21e9c68eee96 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398939 Nov 08 04:36:11.368306 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e48abb1-85a8-4730-831c-152f34945ad6 req-0e6b3d5e-5993-40f5-9361-0a53435278d8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:11.369659 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e48abb1-85a8-4730-831c-152f34945ad6 req-0e6b3d5e-5993-40f5-9361-0a53435278d8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0514634 Nov 08 04:36:11.414926 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e48abb1-85a8-4730-831c-152f34945ad6 req-59d2fa5d-1bda-4a46-8cc6-6c3160e2cf3e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394466 Nov 08 04:36:12.532858 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dae86507-eaca-4797-9972-141c1b9f114d req-5c71a76d-b2aa-4e5b-9d96-6ab3334fafbb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:12.534208 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dae86507-eaca-4797-9972-141c1b9f114d req-5c71a76d-b2aa-4e5b-9d96-6ab3334fafbb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0468347 Nov 08 04:36:12.579762 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dae86507-eaca-4797-9972-141c1b9f114d req-ad3b7a02-900f-4d17-b079-147e3c284de3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392423 Nov 08 04:36:12.663768 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-937a88e3-8d78-416c-91b2-02a005d5b86d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:13.693547 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75e99e17-7c4f-4105-afde-06104450bbff req-96786bbf-4371-44e0-bcee-142cd7e2fd05 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:13.695009 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-75e99e17-7c4f-4105-afde-06104450bbff req-96786bbf-4371-44e0-bcee-142cd7e2fd05 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0473907 Nov 08 04:36:13.743243 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-75e99e17-7c4f-4105-afde-06104450bbff req-384565bf-6519-45cd-8a90-7678ab4f3416 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423887 Nov 08 04:36:14.856174 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb535537-a188-46d5-b86e-82aa53e2456f req-005e7e28-785e-4e0f-907f-7096d3545159 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:14.857541 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fb535537-a188-46d5-b86e-82aa53e2456f req-005e7e28-785e-4e0f-907f-7096d3545159 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0480227 Nov 08 04:36:14.902703 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fb535537-a188-46d5-b86e-82aa53e2456f req-4023ce8e-7db1-472c-84e5-f1202715ab0e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390909 Nov 08 04:36:15.138704 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a9599721-be13-4e73-bc03-db6a00513a2b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:16.016472 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b4b4dae-162b-4b6d-8cb6-7fbc2a5982db req-a17cd124-ec71-4cc3-a5fa-70b446c9657a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:16.017924 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4b4b4dae-162b-4b6d-8cb6-7fbc2a5982db req-a17cd124-ec71-4cc3-a5fa-70b446c9657a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0490210 Nov 08 04:36:16.046849 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:16.064678 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4b4b4dae-162b-4b6d-8cb6-7fbc2a5982db req-2984a970-5cea-41c3-bcf0-0453a182e4f6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402632 Nov 08 04:36:17.179991 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94504340-48e2-4581-b0e8-84ac06c5e83c req-fe72507d-5195-47d0-b28f-a2799194f080 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:17.181465 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-94504340-48e2-4581-b0e8-84ac06c5e83c req-fe72507d-5195-47d0-b28f-a2799194f080 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0510504 Nov 08 04:36:17.227479 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-94504340-48e2-4581-b0e8-84ac06c5e83c req-2e0f8f8b-98a4-44b4-af8c-6322db7a4e53 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402386 Nov 08 04:36:17.720780 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:18.341167 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4bc5b3-3631-4c69-aaf8-5d32f14b0c73 req-f40681dd-ca75-48a7-8df3-c8ab852a5cc2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:18.342682 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f4bc5b3-3631-4c69-aaf8-5d32f14b0c73 req-f40681dd-ca75-48a7-8df3-c8ab852a5cc2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0491083 Nov 08 04:36:18.390239 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f4bc5b3-3631-4c69-aaf8-5d32f14b0c73 req-14b34e8d-c8e5-446c-a5a8-9f7d546aea5d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413070 Nov 08 04:36:18.401145 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:19.505543 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-965b0582-9d1e-4aac-929a-c2c620ce1448 req-00ffc99f-6e5b-46af-9aae-027c218a53c9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:19.506915 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-965b0582-9d1e-4aac-929a-c2c620ce1448 req-00ffc99f-6e5b-46af-9aae-027c218a53c9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0517013 Nov 08 04:36:19.570972 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-965b0582-9d1e-4aac-929a-c2c620ce1448 req-f18e63fe-b53b-4da2-ad2e-5f128484a653 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556901 Nov 08 04:36:20.685324 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae3d41a-e9e7-4f38-a26c-14ff4586741e req-3d0aec8f-c13a-4d7f-be13-c5b8521eb1ac tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:20.686851 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bae3d41a-e9e7-4f38-a26c-14ff4586741e req-3d0aec8f-c13a-4d7f-be13-c5b8521eb1ac tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0475686 Nov 08 04:36:20.732754 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bae3d41a-e9e7-4f38-a26c-14ff4586741e req-75c8f096-5b2a-4ead-88b5-47e9ee31938e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396070 Nov 08 04:36:21.844953 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a73557e-e131-45c8-b79e-55941d89cae4 req-0e253431-8dea-4cdd-b9d5-879669f1524c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:21.846306 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0a73557e-e131-45c8-b79e-55941d89cae4 req-0e253431-8dea-4cdd-b9d5-879669f1524c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0482829 Nov 08 04:36:21.891200 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0a73557e-e131-45c8-b79e-55941d89cae4 req-fb9fc4b9-88f9-4ff1-8329-0492a7d5fbfb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384889 Nov 08 04:36:23.007568 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45714c7f-582e-4a76-943f-0a8f62887272 req-1553595c-03a7-4461-86ee-7359621262b5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:23.009005 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-45714c7f-582e-4a76-943f-0a8f62887272 req-1553595c-03a7-4461-86ee-7359621262b5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0512481 Nov 08 04:36:23.056844 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-45714c7f-582e-4a76-943f-0a8f62887272 req-0e4aaa6b-fc8a-4818-887e-191e9a073a51 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419366 Nov 08 04:36:24.167478 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0d9963-9c8d-47b7-8b87-57f321aabf0b req-31e9b5a7-7e51-4351-af15-272778549fdd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:24.168897 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c0d9963-9c8d-47b7-8b87-57f321aabf0b req-31e9b5a7-7e51-4351-af15-272778549fdd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0471094 Nov 08 04:36:24.213948 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c0d9963-9c8d-47b7-8b87-57f321aabf0b req-240e66e0-646a-40d2-bdde-d197b3597a8d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392439 Nov 08 04:36:24.412382 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:25.328370 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-545d880c-a175-4e57-8487-ccc4559f5026 req-7f218391-5952-47e8-b196-249ff96baaab tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:25.329831 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-545d880c-a175-4e57-8487-ccc4559f5026 req-7f218391-5952-47e8-b196-249ff96baaab tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0501816 Nov 08 04:36:25.374926 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-545d880c-a175-4e57-8487-ccc4559f5026 req-5f2aea47-7a93-43fc-aad5-148149786486 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384197 Nov 08 04:36:26.488775 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b92953a-d416-40cf-a646-64881e12543e req-ec65e815-5416-4603-9284-f87c27fd0f20 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:26.490220 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1b92953a-d416-40cf-a646-64881e12543e req-ec65e815-5416-4603-9284-f87c27fd0f20 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0476217 Nov 08 04:36:26.537119 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1b92953a-d416-40cf-a646-64881e12543e req-c05f7dae-f013-43a7-8493-c5685554ba73 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410569 Nov 08 04:36:27.649681 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c85b5111-4f70-4872-b18d-90b23e4b83a2 req-1e4b74a0-b5b6-45e9-ae54-c4559f68cd52 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:27.651155 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c85b5111-4f70-4872-b18d-90b23e4b83a2 req-1e4b74a0-b5b6-45e9-ae54-c4559f68cd52 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0473487 Nov 08 04:36:27.699863 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c85b5111-4f70-4872-b18d-90b23e4b83a2 req-042497b9-fe12-4c77-942a-5a31e666bc24 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429177 Nov 08 04:36:28.812067 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c88e21-5b01-40fb-bff8-c70f7fd38b25 req-f2b1a03a-1aae-4316-a2cf-1ac3d7201d9b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:28.813472 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-19c88e21-5b01-40fb-bff8-c70f7fd38b25 req-f2b1a03a-1aae-4316-a2cf-1ac3d7201d9b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0465491 Nov 08 04:36:28.860054 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-19c88e21-5b01-40fb-bff8-c70f7fd38b25 req-3400d072-dcf5-4e96-81cb-cbd3a6a25cf0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398393 Nov 08 04:36:29.972645 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cda61bc-5856-4589-9065-683e9ff0a5c1 req-b35e220f-6f75-4edb-81a7-81fc042d95d4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:29.974082 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cda61bc-5856-4589-9065-683e9ff0a5c1 req-b35e220f-6f75-4edb-81a7-81fc042d95d4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0477798 Nov 08 04:36:30.019596 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7cda61bc-5856-4589-9065-683e9ff0a5c1 req-32a03c9b-88f2-4fb2-808d-a44f83d76cb9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390837 Nov 08 04:36:31.133061 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff52ede2-e273-4dd5-9053-f801f1acfd58 req-f1dd3cea-4cf0-4a1f-b88b-c8ac29d686b3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:31.134501 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ff52ede2-e273-4dd5-9053-f801f1acfd58 req-f1dd3cea-4cf0-4a1f-b88b-c8ac29d686b3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0500853 Nov 08 04:36:31.180477 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ff52ede2-e273-4dd5-9053-f801f1acfd58 req-a0c04768-cf1f-4c47-a95b-b1e52ced5082 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401671 Nov 08 04:36:32.293636 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40a592b-f1a4-4156-8a12-106217bbf2e5 req-bc17eb49-6f2e-467d-920d-e4ce1209f0c3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:32.295105 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c40a592b-f1a4-4156-8a12-106217bbf2e5 req-bc17eb49-6f2e-467d-920d-e4ce1209f0c3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0476289 Nov 08 04:36:32.340819 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c40a592b-f1a4-4156-8a12-106217bbf2e5 req-1aeaee19-98b6-450a-a58f-681a0c08c64c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399346 Nov 08 04:36:33.451735 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4812d703-5124-47a6-a1a7-480bc4aee71b req-a28d12a7-7729-44e0-a741-cf900535d7be tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:33.453177 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4812d703-5124-47a6-a1a7-480bc4aee71b req-a28d12a7-7729-44e0-a741-cf900535d7be tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0472898 Nov 08 04:36:33.502361 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4812d703-5124-47a6-a1a7-480bc4aee71b req-3d1330e1-2f53-4cc2-8dcc-5c48e4adb556 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431631 Nov 08 04:36:34.616809 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc4bf2b-a917-4a8f-82d0-beabfe903d36 req-f4a6e3f4-0606-4404-8f0c-752fde1ef3ce tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:34.618268 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cfc4bf2b-a917-4a8f-82d0-beabfe903d36 req-f4a6e3f4-0606-4404-8f0c-752fde1ef3ce tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0494425 Nov 08 04:36:34.664016 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cfc4bf2b-a917-4a8f-82d0-beabfe903d36 req-28119ed2-357f-49a2-b4b4-d12ffa3a14cd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399091 Nov 08 04:36:35.776167 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-517ca17a-fb8e-4b9d-a6b1-47a695536e3a req-f87ba9dd-3203-4591-8f84-a491e254dd2f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:35.777622 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-517ca17a-fb8e-4b9d-a6b1-47a695536e3a req-f87ba9dd-3203-4591-8f84-a491e254dd2f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0476248 Nov 08 04:36:35.823975 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-517ca17a-fb8e-4b9d-a6b1-47a695536e3a req-321d03ee-cedb-4f87-bcd9-1ad92b904810 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405753 Nov 08 04:36:36.941536 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3bc5769-bf60-4ca9-92e1-f08aa0ccc276 req-884f02bc-9616-4b00-8e59-e669118bacef tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:36.943067 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e3bc5769-bf60-4ca9-92e1-f08aa0ccc276 req-884f02bc-9616-4b00-8e59-e669118bacef tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0515182 Nov 08 04:36:36.989175 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e3bc5769-bf60-4ca9-92e1-f08aa0ccc276 req-03a4a0e3-2d27-49fe-8c6e-0443a93fa98f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402198 Nov 08 04:36:38.100720 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40495246-d99e-4153-be6d-ee3c7e6c71a6 req-319016cb-6b39-4f01-b978-3bd83d674143 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:38.102135 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-40495246-d99e-4153-be6d-ee3c7e6c71a6 req-319016cb-6b39-4f01-b978-3bd83d674143 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0468535 Nov 08 04:36:38.147296 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-40495246-d99e-4153-be6d-ee3c7e6c71a6 req-c38421c9-d4c9-4f4d-a998-ed20e5ccf870 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392497 Nov 08 04:36:38.937065 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:36:39.261891 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e7ea799-7fe4-4d20-aea3-769a93a73a25 req-be88a45b-9a17-41d3-864c-ec3c7f91a0af tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:39.263339 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e7ea799-7fe4-4d20-aea3-769a93a73a25 req-be88a45b-9a17-41d3-864c-ec3c7f91a0af tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0502458 Nov 08 04:36:39.308708 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e7ea799-7fe4-4d20-aea3-769a93a73a25 req-f168d298-adf8-4cbc-8da7-8e39ad0b38eb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396039 Nov 08 04:36:40.421348 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a1869d5-0350-463b-88ce-fef1454fdf6c req-64bdf9a9-5211-44e4-afb3-2ed586fa1896 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:40.422835 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2a1869d5-0350-463b-88ce-fef1454fdf6c req-64bdf9a9-5211-44e4-afb3-2ed586fa1896 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0477314 Nov 08 04:36:40.469099 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2a1869d5-0350-463b-88ce-fef1454fdf6c req-7a410e28-1efe-4d45-885d-72c492f04d24 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404849 Nov 08 04:36:41.583611 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b48cdb6-5e12-42d1-8140-096eba759836 req-ac45d588-c1f9-421d-8e22-513c19fb1fb8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:41.586741 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1b48cdb6-5e12-42d1-8140-096eba759836 req-ac45d588-c1f9-421d-8e22-513c19fb1fb8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0501983 Nov 08 04:36:41.642112 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1b48cdb6-5e12-42d1-8140-096eba759836 req-114651c1-f7a9-4a30-b05b-25a463b6d19d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451252 Nov 08 04:36:42.668861 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-932b1731-4623-4807-8783-80b030b63874 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:42.755286 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f321e18-56d9-4835-9cf0-84646aaa3c56 req-c4241bc5-77a7-4a48-be7b-f8e38f09e5a3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:42.756727 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9f321e18-56d9-4835-9cf0-84646aaa3c56 req-c4241bc5-77a7-4a48-be7b-f8e38f09e5a3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0493813 Nov 08 04:36:42.802820 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9f321e18-56d9-4835-9cf0-84646aaa3c56 req-4eb0a639-1601-4964-82c0-313bd3142bf4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403614 Nov 08 04:36:43.659595 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-fca22036-c8f2-4002-b3b5-2ed26862d919 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0381069 Nov 08 04:36:43.755106 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-ee1c95bf-340c-46b0-a2c9-495f696bd7e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:43.756633 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-ee1c95bf-340c-46b0-a2c9-495f696bd7e5 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0392184 Nov 08 04:36:43.860780 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-376c6a7c-d05a-4065-839f-9788ca2252de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:43.862788 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-376c6a7c-d05a-4065-839f-9788ca2252de service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0855334 Nov 08 04:36:43.957588 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-3b102ba9-ad8a-44be-8c40-3cb4e6fe54cd service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0865088 Nov 08 04:36:43.965033 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f63659-b5f3-4ab2-aea8-272bb531dbf8 req-25b959db-a71e-414d-a4b6-7319a41b6190 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:43.966402 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a4f63659-b5f3-4ab2-aea8-272bb531dbf8 req-25b959db-a71e-414d-a4b6-7319a41b6190 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0973566 Nov 08 04:36:44.031529 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-07264f79-18ab-47da-bc98-feb0581fdcc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:44.032966 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-07264f79-18ab-47da-bc98-feb0581fdcc0 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0657122 Nov 08 04:36:44.053078 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a4f63659-b5f3-4ab2-aea8-272bb531dbf8 req-368ebcf0-8850-4b85-8873-1c9db055a5ef tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784094 Nov 08 04:36:44.084334 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-c407f207-ef59-4644-887f-4daa69148b82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:44.085783 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-c407f207-ef59-4644-887f-4daa69148b82 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0452120 Nov 08 04:36:44.171923 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-836c6441-2817-43d4-98ad-5c35ff7bf05d service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0787296 Nov 08 04:36:44.262154 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f6cab53b-967c-42bc-be98-d4c5edf9e45e req-1fd92eee-b81a-414a-99a3-80760e52c81e service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821791 Nov 08 04:36:45.137580 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-ea6bc0b5-306d-4e3c-ad19-71cada70f606 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:45.167709 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf7b284-0b18-452a-b668-4bbf826f3b79 req-6466bc54-d802-45a8-a930-ff0a560ef661 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:45.169228 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2bf7b284-0b18-452a-b668-4bbf826f3b79 req-6466bc54-d802-45a8-a930-ff0a560ef661 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0488105 Nov 08 04:36:45.214626 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2bf7b284-0b18-452a-b668-4bbf826f3b79 req-fc177363-3a7c-4a8c-acc6-b9a4bc3accb2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391059 Nov 08 04:36:46.091739 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:46.327195 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c452148c-729a-40c0-8f80-846beb350623 req-465e4c3a-8554-490e-bd67-cd704c1425ad tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:46.328549 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c452148c-729a-40c0-8f80-846beb350623 req-465e4c3a-8554-490e-bd67-cd704c1425ad tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0468454 Nov 08 04:36:46.377348 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c452148c-729a-40c0-8f80-846beb350623 req-266c86cc-54de-4cfb-98d3-6b63cdacb9b6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421872 Nov 08 04:36:47.506332 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a3f68b6-c83c-4c81-bc9b-0f2e58f20112 req-1351566a-c80b-4f4a-b0b4-16f4227ac62d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:47.507844 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0a3f68b6-c83c-4c81-bc9b-0f2e58f20112 req-1351566a-c80b-4f4a-b0b4-16f4227ac62d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0621858 Nov 08 04:36:47.554659 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0a3f68b6-c83c-4c81-bc9b-0f2e58f20112 req-9d774a82-1d34-46d5-8b0c-8d24e1a2408d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407696 Nov 08 04:36:47.725874 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:48.399903 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:48.666245 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1fba502-8518-4de3-97ee-ec5af286914b req-772e76b3-4d99-4c22-abe1-c7dd4970cca7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:48.667624 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e1fba502-8518-4de3-97ee-ec5af286914b req-772e76b3-4d99-4c22-abe1-c7dd4970cca7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0466087 Nov 08 04:36:48.713550 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e1fba502-8518-4de3-97ee-ec5af286914b req-74c12fb3-3d85-4f74-a31a-1eeaf85ec687 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401771 Nov 08 04:36:49.831476 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2da00ee-9375-4df7-bc30-d67854953c6b req-363ca585-830c-4950-931b-e864aedb4bfb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:49.833170 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a2da00ee-9375-4df7-bc30-d67854953c6b req-363ca585-830c-4950-931b-e864aedb4bfb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0541034 Nov 08 04:36:49.878185 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a2da00ee-9375-4df7-bc30-d67854953c6b req-027f90ea-340d-408b-8c58-d62b9118ddf1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389550 Nov 08 04:36:50.994795 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06bbd17d-c71c-4e50-a5b8-9660548a5254 req-c562c417-0b2f-47d0-b09f-498f914790ec tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:50.996349 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06bbd17d-c71c-4e50-a5b8-9660548a5254 req-c562c417-0b2f-47d0-b09f-498f914790ec tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0521164 Nov 08 04:36:51.041609 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06bbd17d-c71c-4e50-a5b8-9660548a5254 req-bcb23817-2d91-4faf-be78-298b6d38f70d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393553 Nov 08 04:36:52.153320 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b239ba3-02a1-458b-935b-f920445a28e2 req-33f4f813-7499-49f1-8155-f6b37787f2cd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:52.154740 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7b239ba3-02a1-458b-935b-f920445a28e2 req-33f4f813-7499-49f1-8155-f6b37787f2cd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0460396 Nov 08 04:36:52.202878 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7b239ba3-02a1-458b-935b-f920445a28e2 req-83136170-ca33-4754-9899-8f37e1c70bc0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417342 Nov 08 04:36:53.315181 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9a69ee-0647-4540-a175-b2b8a1059137 req-7255fbb6-9ec4-4f3d-b3ac-686dc625b5ee tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:53.316646 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3a9a69ee-0647-4540-a175-b2b8a1059137 req-7255fbb6-9ec4-4f3d-b3ac-686dc625b5ee tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0469229 Nov 08 04:36:53.362021 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3a9a69ee-0647-4540-a175-b2b8a1059137 req-4bb41344-b22d-4602-b0f7-67e16b56237b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397398 Nov 08 04:36:54.417239 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:36:54.473303 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb86d052-21f2-4823-a40b-5314090f5c33 req-4cf95fa3-9971-4578-b9d2-1b55224fcaec tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:54.474755 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eb86d052-21f2-4823-a40b-5314090f5c33 req-4cf95fa3-9971-4578-b9d2-1b55224fcaec tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0473847 Nov 08 04:36:54.519119 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eb86d052-21f2-4823-a40b-5314090f5c33 req-a29e839b-02b4-4387-835e-e81d75b71dfc tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385437 Nov 08 04:36:55.641868 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b27dc82-957a-4e58-9c90-4bd4ce48a0da req-a404ae50-886a-4072-9a66-50abc2ec4a9a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:55.643355 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6b27dc82-957a-4e58-9c90-4bd4ce48a0da req-a404ae50-886a-4072-9a66-50abc2ec4a9a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0530896 Nov 08 04:36:55.688588 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6b27dc82-957a-4e58-9c90-4bd4ce48a0da req-39dfeac7-2054-4b26-90d1-1383f09b3c90 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394118 Nov 08 04:36:56.806013 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eb40423-0948-4c98-856f-7ca10e4cf5ea req-2e8fd47e-b714-448b-ad67-381241cd3382 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:56.807850 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1eb40423-0948-4c98-856f-7ca10e4cf5ea req-2e8fd47e-b714-448b-ad67-381241cd3382 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0527358 Nov 08 04:36:56.855136 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1eb40423-0948-4c98-856f-7ca10e4cf5ea req-bc7d09ee-735e-45f3-bddc-cd33b5cb20e3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404773 Nov 08 04:36:57.971075 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623902df-d247-483a-bcae-31da7aa0ae78 req-349b4263-0b92-4cbf-8f11-122e30972792 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:57.973173 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-623902df-d247-483a-bcae-31da7aa0ae78 req-349b4263-0b92-4cbf-8f11-122e30972792 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0509365 Nov 08 04:36:58.017208 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-623902df-d247-483a-bcae-31da7aa0ae78 req-73e12f5e-d8c0-445c-8fe6-6fffaa78aae7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382664 Nov 08 04:36:59.129489 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1abae6b-9f08-4115-9bd2-1622b146a9ca req-9e03e051-5569-4156-aab9-be7a46b2003a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:36:59.130938 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1abae6b-9f08-4115-9bd2-1622b146a9ca req-9e03e051-5569-4156-aab9-be7a46b2003a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0472906 Nov 08 04:36:59.176088 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1abae6b-9f08-4115-9bd2-1622b146a9ca req-1a83f0a4-b80c-4dcb-a2b9-554681b33531 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394638 Nov 08 04:37:00.286034 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f346f0cb-67e3-4941-b873-879c2a140732 req-b567f999-2f8a-4a49-913c-f121ccf85518 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:00.287460 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f346f0cb-67e3-4941-b873-879c2a140732 req-b567f999-2f8a-4a49-913c-f121ccf85518 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0462227 Nov 08 04:37:00.335796 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f346f0cb-67e3-4941-b873-879c2a140732 req-d889a24d-74b6-4666-8754-8497736709c9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426092 Nov 08 04:37:01.450928 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-202c577c-c573-46c5-8def-ebfab4bbe19a req-0c5c3bbe-766b-41b5-a2aa-ad60f424c075 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:01.452365 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-202c577c-c573-46c5-8def-ebfab4bbe19a req-0c5c3bbe-766b-41b5-a2aa-ad60f424c075 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0483205 Nov 08 04:37:01.501268 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-202c577c-c573-46c5-8def-ebfab4bbe19a req-fefb91d6-0605-4c95-b27e-7228c120a8dd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425825 Nov 08 04:37:02.628904 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a12618f4-e939-423c-88c5-e663c24183e1 req-0f271410-446c-4027-b793-a0cfff24dc79 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:02.630352 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a12618f4-e939-423c-88c5-e663c24183e1 req-0f271410-446c-4027-b793-a0cfff24dc79 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0470743 Nov 08 04:37:02.676313 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a12618f4-e939-423c-88c5-e663c24183e1 req-9537486b-157a-4480-b087-1e7a5a476142 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401046 Nov 08 04:37:03.792189 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f04e7472-9a7d-4b2e-aa5c-82d53024acfa req-94388c22-3100-4b05-8b1a-832c1466f054 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:03.793613 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f04e7472-9a7d-4b2e-aa5c-82d53024acfa req-94388c22-3100-4b05-8b1a-832c1466f054 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0499587 Nov 08 04:37:03.839718 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f04e7472-9a7d-4b2e-aa5c-82d53024acfa req-d9514fbf-01dc-4b44-95a4-811e278950a3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403066 Nov 08 04:37:04.953162 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad3856b-a09d-460e-b9db-87a51731c20b req-4a52af17-ac59-4f25-b652-3ace9ab5410b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:04.954607 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bad3856b-a09d-460e-b9db-87a51731c20b req-4a52af17-ac59-4f25-b652-3ace9ab5410b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0479796 Nov 08 04:37:04.999805 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bad3856b-a09d-460e-b9db-87a51731c20b req-67f26006-1d65-463a-9a8b-90dfe0e49386 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391517 Nov 08 04:37:06.111173 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033ce3d5-4f60-4b09-b468-7385dfe8c304 req-ed210d52-09dd-499d-9599-206349bda0b0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:06.113141 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-033ce3d5-4f60-4b09-b468-7385dfe8c304 req-ed210d52-09dd-499d-9599-206349bda0b0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0464044 Nov 08 04:37:06.160817 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-033ce3d5-4f60-4b09-b468-7385dfe8c304 req-3a2c4275-7c2c-4975-8fe6-83d5eb158342 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419459 Nov 08 04:37:07.273590 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd10ba0-b2f6-4259-bc4d-8f2171cd336b req-64a011d2-d2e4-4baf-a01a-11c15a8bd691 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:07.275055 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2fd10ba0-b2f6-4259-bc4d-8f2171cd336b req-64a011d2-d2e4-4baf-a01a-11c15a8bd691 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0469520 Nov 08 04:37:07.320797 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2fd10ba0-b2f6-4259-bc4d-8f2171cd336b req-0dad18dc-3b08-45f9-8f14-14717fdf2b02 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400414 Nov 08 04:37:08.437349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66941d3c-3359-40c1-a308-146d2b3a8755 req-1ea6d95a-318a-4e42-bc82-ca1c6977e919 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:08.442502 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-66941d3c-3359-40c1-a308-146d2b3a8755 req-1ea6d95a-318a-4e42-bc82-ca1c6977e919 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0498128 Nov 08 04:37:08.486295 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-66941d3c-3359-40c1-a308-146d2b3a8755 req-8716f4f4-1fa2-4b23-bd87-269ecc5c21f3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413649 Nov 08 04:37:09.610830 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf4d245-1183-46da-a488-f34152f99457 req-63ca9e04-6297-4271-ad62-9db0a925caee tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:09.613052 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-adf4d245-1183-46da-a488-f34152f99457 req-63ca9e04-6297-4271-ad62-9db0a925caee tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0567608 Nov 08 04:37:09.658996 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-adf4d245-1183-46da-a488-f34152f99457 req-9fa98867-81ab-485e-bd99-3533df61e627 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395973 Nov 08 04:37:10.775080 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8662f20d-1e39-4e99-80ff-54e75b706159 req-91ba925e-a173-49ac-aac3-e7f5fa9ace40 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:10.776510 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8662f20d-1e39-4e99-80ff-54e75b706159 req-91ba925e-a173-49ac-aac3-e7f5fa9ace40 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0477998 Nov 08 04:37:10.822008 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8662f20d-1e39-4e99-80ff-54e75b706159 req-389beb8b-a0fa-4a6b-8d35-a4409c1b745e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398088 Nov 08 04:37:11.937606 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1dbb8dd-4806-44c2-8422-fce18a114809 req-f902fe37-4c06-4242-adfc-0189176c6bab tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:11.939051 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d1dbb8dd-4806-44c2-8422-fce18a114809 req-f902fe37-4c06-4242-adfc-0189176c6bab tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0497098 Nov 08 04:37:11.984538 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d1dbb8dd-4806-44c2-8422-fce18a114809 req-d6005e8f-f4c9-4f89-a963-e0a1ca072a35 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392613 Nov 08 04:37:12.668337 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-17ff2bf9-2173-459c-9f44-024083abf10d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:13.097065 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d9790a-6ee4-48aa-9f79-aba3f66de858 req-bfdeabe1-47be-429d-a7b2-f5afd738f30a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:13.098531 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c1d9790a-6ee4-48aa-9f79-aba3f66de858 req-bfdeabe1-47be-429d-a7b2-f5afd738f30a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0481176 Nov 08 04:37:13.143841 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c1d9790a-6ee4-48aa-9f79-aba3f66de858 req-57ec43e6-2f2e-4638-97d1-a27f9265fdef tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393107 Nov 08 04:37:14.257382 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb4ba2ad-6733-4437-a426-44b3d80f8690 req-6a48d035-da01-4d99-9172-b9df0b499d03 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:14.258816 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eb4ba2ad-6733-4437-a426-44b3d80f8690 req-6a48d035-da01-4d99-9172-b9df0b499d03 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0467122 Nov 08 04:37:14.306416 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eb4ba2ad-6733-4437-a426-44b3d80f8690 req-da1f9f34-be9c-4607-a620-0c9075c17d9e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418723 Nov 08 04:37:15.154029 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d93d5942-cb20-49de-a0bf-cfc4b690f786 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:15.417777 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80676ac9-ae6d-47bb-acab-367908710dbf req-197c726f-1d86-403e-9a7a-4582d9eebc73 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:15.419135 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80676ac9-ae6d-47bb-acab-367908710dbf req-197c726f-1d86-403e-9a7a-4582d9eebc73 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0471129 Nov 08 04:37:15.464135 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-80676ac9-ae6d-47bb-acab-367908710dbf req-fbae06bb-a397-46d3-ac6a-bf155bb0a832 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392880 Nov 08 04:37:15.935239 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:37:16.056369 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:16.585955 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff09126a-1d26-4e2b-b696-6f568113bbd2 req-ff62b623-354a-4bbb-b454-bf84e070a8b6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:16.587472 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ff09126a-1d26-4e2b-b696-6f568113bbd2 req-ff62b623-354a-4bbb-b454-bf84e070a8b6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0483844 Nov 08 04:37:16.633056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ff09126a-1d26-4e2b-b696-6f568113bbd2 req-3d8f6e88-ab59-41e3-a324-64f9aa784171 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397415 Nov 08 04:37:17.725698 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:17.755429 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ddd39d-4378-430b-8ddb-63c84babaac4 req-6e86b61d-d43f-4da3-8b68-108aceb66198 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:17.756863 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b0ddd39d-4378-430b-8ddb-63c84babaac4 req-6e86b61d-d43f-4da3-8b68-108aceb66198 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0572174 Nov 08 04:37:17.802352 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b0ddd39d-4378-430b-8ddb-63c84babaac4 req-882e180a-517f-4b35-b99b-63ee20cabb55 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396619 Nov 08 04:37:18.399364 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:18.917078 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4353227e-385b-4702-8e51-b82bff13216c req-bb298b28-20b4-4a8b-930e-e4ff3a1f148a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:18.918542 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4353227e-385b-4702-8e51-b82bff13216c req-bb298b28-20b4-4a8b-930e-e4ff3a1f148a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0476737 Nov 08 04:37:18.963922 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4353227e-385b-4702-8e51-b82bff13216c req-625936c9-ba01-4198-919f-7fdbee2a1755 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395727 Nov 08 04:37:20.076109 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b470836e-14e1-4fae-9689-97db9fee272e req-46c50172-72ff-4999-b3b5-969698f2b570 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:20.077525 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b470836e-14e1-4fae-9689-97db9fee272e req-46c50172-72ff-4999-b3b5-969698f2b570 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0475767 Nov 08 04:37:20.125260 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b470836e-14e1-4fae-9689-97db9fee272e req-dc1a8c09-dff6-4735-a152-c101ff817819 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411086 Nov 08 04:37:21.241889 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef7db22-b985-422a-a479-e78202476105 req-5d278fb0-720c-4db3-bfbb-2aaf84c88755 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:21.243358 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ef7db22-b985-422a-a479-e78202476105 req-5d278fb0-720c-4db3-bfbb-2aaf84c88755 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0509858 Nov 08 04:37:21.288561 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ef7db22-b985-422a-a479-e78202476105 req-03d249a8-dd36-4c9e-8d18-6c2d6cced50e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394430 Nov 08 04:37:22.399204 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34b57bcc-aa61-4f61-ad2d-448f1e9b85e3 req-5a795257-d948-4647-94d2-a68dd27169ed tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:22.400612 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34b57bcc-aa61-4f61-ad2d-448f1e9b85e3 req-5a795257-d948-4647-94d2-a68dd27169ed tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0462267 Nov 08 04:37:22.445133 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34b57bcc-aa61-4f61-ad2d-448f1e9b85e3 req-afee3e87-be81-454a-a76a-5f5210448ba0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388591 Nov 08 04:37:23.559329 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd5efef-bef6-434b-9351-7e6346320307 req-811a1831-fa43-4f0e-807d-2c6de96a9256 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:23.560754 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3bd5efef-bef6-434b-9351-7e6346320307 req-811a1831-fa43-4f0e-807d-2c6de96a9256 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0501177 Nov 08 04:37:23.607354 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3bd5efef-bef6-434b-9351-7e6346320307 req-f47820ab-6c43-4d5f-a6e6-0a15ffc17a68 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407991 Nov 08 04:37:24.427843 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:24.717357 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3d8348-dd45-4a39-bc18-266fa2df0219 req-11813847-c907-40d1-a119-bbfbc2a03dfd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:24.718704 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6c3d8348-dd45-4a39-bc18-266fa2df0219 req-11813847-c907-40d1-a119-bbfbc2a03dfd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0467312 Nov 08 04:37:24.764332 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6c3d8348-dd45-4a39-bc18-266fa2df0219 req-36d1e8d8-bfdc-4c1b-9221-0537e152f15e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393989 Nov 08 04:37:25.881322 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b3101c-52d6-4ff5-8f2b-82f299aa9c93 req-b2d6cecc-a69a-48dd-b5b3-a8104c876851 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:25.882723 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31b3101c-52d6-4ff5-8f2b-82f299aa9c93 req-b2d6cecc-a69a-48dd-b5b3-a8104c876851 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0528896 Nov 08 04:37:25.928461 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-31b3101c-52d6-4ff5-8f2b-82f299aa9c93 req-a113169d-59f4-42ea-b837-ba3fefa32f75 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398109 Nov 08 04:37:27.044150 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c27844-474a-4c2d-a845-cf3d824969e6 req-8c4f3401-1d33-4fa2-bc01-1ad6fadf2d45 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:27.045588 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e3c27844-474a-4c2d-a845-cf3d824969e6 req-8c4f3401-1d33-4fa2-bc01-1ad6fadf2d45 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0479169 Nov 08 04:37:27.090736 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e3c27844-474a-4c2d-a845-cf3d824969e6 req-ffdedb81-dafb-49f3-b01b-33a7381841d9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392330 Nov 08 04:37:28.203994 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cbb4b39-da3f-42fe-ac02-61c6035629c8 req-52b89909-2877-4c04-b3f8-ac16f35b937e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:28.205432 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0cbb4b39-da3f-42fe-ac02-61c6035629c8 req-52b89909-2877-4c04-b3f8-ac16f35b937e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0471640 Nov 08 04:37:28.254101 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0cbb4b39-da3f-42fe-ac02-61c6035629c8 req-ab5f642f-dc92-4eb6-b769-eb087a3825a6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426865 Nov 08 04:37:29.364430 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-671139bf-ee44-4bc2-9340-0d0707d56789 req-b613b951-e5af-4d2d-9d54-fdfbc83ba10e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:29.365844 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-671139bf-ee44-4bc2-9340-0d0707d56789 req-b613b951-e5af-4d2d-9d54-fdfbc83ba10e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0463016 Nov 08 04:37:29.410612 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-671139bf-ee44-4bc2-9340-0d0707d56789 req-d38eab26-871b-4444-98aa-c0d083efdc59 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389571 Nov 08 04:37:30.521855 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c89f8147-d557-44d4-a25b-964fd955c378 req-9202ef10-47fb-42de-b9ec-4602eaca40c8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:30.523295 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c89f8147-d557-44d4-a25b-964fd955c378 req-9202ef10-47fb-42de-b9ec-4602eaca40c8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0468223 Nov 08 04:37:30.568490 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c89f8147-d557-44d4-a25b-964fd955c378 req-9e51b796-87ae-4f1d-8211-566ccb61a9e7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393639 Nov 08 04:37:31.689199 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9633275d-a900-4362-863c-f25c49618392 req-a5cd24b7-f1c2-4d94-8050-3c277164c394 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:31.690676 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9633275d-a900-4362-863c-f25c49618392 req-a5cd24b7-f1c2-4d94-8050-3c277164c394 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0505848 Nov 08 04:37:31.736104 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9633275d-a900-4362-863c-f25c49618392 req-260619e0-5ce9-450a-ab64-e9a0c56a8214 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396841 Nov 08 04:37:32.853037 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc41927-f1b2-4a48-9a1d-abf1493b0646 req-2bc7b85a-6c79-4f58-ba65-a5c63b7fc20f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:32.854404 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4fc41927-f1b2-4a48-9a1d-abf1493b0646 req-2bc7b85a-6c79-4f58-ba65-a5c63b7fc20f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0473318 Nov 08 04:37:32.899470 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4fc41927-f1b2-4a48-9a1d-abf1493b0646 req-289c31c9-6afd-4efc-aab0-57b7327197e7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393150 Nov 08 04:37:34.010507 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c67cb4dc-9c6c-4d2a-98a4-16cf09433577 req-e931bdf6-116b-418e-bef8-3aa23b257824 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:34.011906 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c67cb4dc-9c6c-4d2a-98a4-16cf09433577 req-e931bdf6-116b-418e-bef8-3aa23b257824 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0465758 Nov 08 04:37:34.058718 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c67cb4dc-9c6c-4d2a-98a4-16cf09433577 req-b87dc5b9-e40a-4374-bc2b-7cf33f57330e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411479 Nov 08 04:37:35.171126 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aba4c35-cce8-4064-a136-53560b152915 req-64e424e8-ec11-4f3a-ace6-802c15c2c178 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:35.172592 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6aba4c35-cce8-4064-a136-53560b152915 req-64e424e8-ec11-4f3a-ace6-802c15c2c178 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0468907 Nov 08 04:37:35.217686 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6aba4c35-cce8-4064-a136-53560b152915 req-50176b33-bbe6-4ee7-96d3-12f921daa378 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386925 Nov 08 04:37:36.330025 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eac2e8d0-aafa-4191-9f89-477780b1b9e2 req-68b8fbc2-068a-4458-8050-87c50300f9ab tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:36.331776 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eac2e8d0-aafa-4191-9f89-477780b1b9e2 req-68b8fbc2-068a-4458-8050-87c50300f9ab tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0486486 Nov 08 04:37:36.376301 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eac2e8d0-aafa-4191-9f89-477780b1b9e2 req-8c0f1403-3dd1-48db-9d11-ffeb3396b23a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389264 Nov 08 04:37:37.491615 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb3cef4-6153-4fde-b15c-7c74785c07f6 req-3b9ca67a-95d3-4130-b19f-0a4341886e27 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:37.493056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3eb3cef4-6153-4fde-b15c-7c74785c07f6 req-3b9ca67a-95d3-4130-b19f-0a4341886e27 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0508018 Nov 08 04:37:37.537955 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3eb3cef4-6153-4fde-b15c-7c74785c07f6 req-a2fc9297-cd43-4063-9a66-67587ce3027f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392127 Nov 08 04:37:38.649957 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0057949-fc6e-4fa2-9f00-ea919facd15a req-24919557-2e12-4a79-ac1a-38f2ff5f89cb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:38.651458 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c0057949-fc6e-4fa2-9f00-ea919facd15a req-24919557-2e12-4a79-ac1a-38f2ff5f89cb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0469410 Nov 08 04:37:38.696766 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c0057949-fc6e-4fa2-9f00-ea919facd15a req-e2bac4a5-d549-465d-88f3-4e1753c97790 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396285 Nov 08 04:37:39.817170 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2411acfc-0e45-489b-9b6d-d32904421887 req-abb99e7c-8a2c-4427-bd56-06d2d2c80212 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:39.818621 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2411acfc-0e45-489b-9b6d-d32904421887 req-abb99e7c-8a2c-4427-bd56-06d2d2c80212 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0502813 Nov 08 04:37:39.864262 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2411acfc-0e45-489b-9b6d-d32904421887 req-e382c530-a567-479e-bff9-48a9729e5afb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398490 Nov 08 04:37:40.975831 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7ae9b5-806f-4369-a508-5853d5ea0f45 req-2474ca45-c55f-472d-929a-0a1d45090fc5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:40.977258 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1d7ae9b5-806f-4369-a508-5853d5ea0f45 req-2474ca45-c55f-472d-929a-0a1d45090fc5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0473573 Nov 08 04:37:41.021691 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1d7ae9b5-806f-4369-a508-5853d5ea0f45 req-95fc309b-4cbd-4713-8cac-b9a1f1d25526 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387223 Nov 08 04:37:42.139047 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c5b981f-0746-412f-85d6-b08607353ac4 req-c40205d0-9cef-47a1-9188-84c6fa58712f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:42.140469 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1c5b981f-0746-412f-85d6-b08607353ac4 req-c40205d0-9cef-47a1-9188-84c6fa58712f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0496118 Nov 08 04:37:42.188551 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1c5b981f-0746-412f-85d6-b08607353ac4 req-2e8b3219-575b-4245-b09b-bbb7d79ad7f6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423052 Nov 08 04:37:42.679083 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a50cd806-c8de-4b2d-b82f-1ad0cf49700c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:43.301134 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd6621e-e200-4b5a-89f3-5e952b741be9 req-3340aa0d-3f3f-435f-af17-3af7f3703bc1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:43.302567 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dfd6621e-e200-4b5a-89f3-5e952b741be9 req-3340aa0d-3f3f-435f-af17-3af7f3703bc1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0469918 Nov 08 04:37:43.347243 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dfd6621e-e200-4b5a-89f3-5e952b741be9 req-9c5303aa-6e26-41c0-9817-f8c954691f51 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384839 Nov 08 04:37:44.462093 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13432bac-a1f2-4058-8be2-92f476680fd8 req-9ed8ed54-3e1b-4668-a617-0b7b31738773 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:44.463592 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-13432bac-a1f2-4058-8be2-92f476680fd8 req-9ed8ed54-3e1b-4668-a617-0b7b31738773 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0483403 Nov 08 04:37:44.510034 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-13432bac-a1f2-4058-8be2-92f476680fd8 req-673ef65a-8a6f-4091-913b-57a35074531b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398414 Nov 08 04:37:45.152993 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9d8e8d9a-3155-4e71-834b-c7e802a0a6bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:45.887940 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c50237d1-6d0e-4df2-bc0f-b739d4d5b7b7 req-6eecf909-a94a-4967-86b8-efb6905141b2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:45.889375 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c50237d1-6d0e-4df2-bc0f-b739d4d5b7b7 req-6eecf909-a94a-4967-86b8-efb6905141b2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.3128958 Nov 08 04:37:45.933770 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c50237d1-6d0e-4df2-bc0f-b739d4d5b7b7 req-b0b64724-3b7d-4a65-95bb-3998269f8f67 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384099 Nov 08 04:37:46.061819 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:46.418367 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-da77822a-8938-4d2d-a047-a5e0bfe6fb3d service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1432891 Nov 08 04:37:46.512678 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-804fa077-42e6-4615-8ca7-f16bba63790d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:46.514089 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-804fa077-42e6-4615-8ca7-f16bba63790d service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0389750 Nov 08 04:37:46.616696 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-27c1c4e9-a638-4c9f-baef-72d260fe65fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:46.618155 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-27c1c4e9-a638-4c9f-baef-72d260fe65fb service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0859377 Nov 08 04:37:46.681038 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-a92226c2-25c3-486c-8185-1e64670f564a service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0561769 Nov 08 04:37:46.730540 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-f4b3e483-ea51-4f23-b87e-f30ef0a7b805 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:46.731872 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-f4b3e483-ea51-4f23-b87e-f30ef0a7b805 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0439584 Nov 08 04:37:46.775097 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-e0b77e1a-f4fe-4827-8bb6-2dfcc4d302fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:46.776567 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-e0b77e1a-f4fe-4827-8bb6-2dfcc4d302fa service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0373251 Nov 08 04:37:46.861809 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-8e885efc-e688-4796-af66-bc12d3b7fa1c service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0780768 Nov 08 04:37:46.952638 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f69034c7-b46e-48db-b483-d35c9cbd13d6 req-a66d1490-5d5e-47b1-9eb9-d21dd1eae96e service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831389 Nov 08 04:37:47.058011 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01052ae1-c670-4420-968e-df45d29ae4ef req-b0f21a0a-b801-4bb8-8a31-1e1678ef8fab tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:47.059522 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-01052ae1-c670-4420-968e-df45d29ae4ef req-b0f21a0a-b801-4bb8-8a31-1e1678ef8fab tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0586357 Nov 08 04:37:47.105355 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-01052ae1-c670-4420-968e-df45d29ae4ef req-299f9c2d-1fa0-43fa-a936-5f7b833c5f62 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400445 Nov 08 04:37:47.713059 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:48.220744 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e9c8fec-b168-4d1b-98c8-c7c5bdc3d152 req-ec7494eb-4939-41be-bc2c-8f6581a24a41 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:48.222271 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e9c8fec-b168-4d1b-98c8-c7c5bdc3d152 req-ec7494eb-4939-41be-bc2c-8f6581a24a41 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0510120 Nov 08 04:37:48.266901 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e9c8fec-b168-4d1b-98c8-c7c5bdc3d152 req-98d1ba60-2277-45bf-881d-2f5652097b0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388947 Nov 08 04:37:48.386953 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:49.379575 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe2b1d5-f278-4ee1-9d2d-65582a7face7 req-3abeec16-c08d-4b06-9aa9-97a742fe5b28 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:49.381038 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2fe2b1d5-f278-4ee1-9d2d-65582a7face7 req-3abeec16-c08d-4b06-9aa9-97a742fe5b28 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0477819 Nov 08 04:37:49.426701 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2fe2b1d5-f278-4ee1-9d2d-65582a7face7 req-edbb154e-fd03-44f5-969e-43feb5d1aaa9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398824 Nov 08 04:37:50.538664 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00e0a3ca-feb7-45d9-a948-237bed3e9f9a req-43c9f5c3-3439-417f-8640-89ba68b46239 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:50.540093 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00e0a3ca-feb7-45d9-a948-237bed3e9f9a req-43c9f5c3-3439-417f-8640-89ba68b46239 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0472183 Nov 08 04:37:50.589524 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00e0a3ca-feb7-45d9-a948-237bed3e9f9a req-4efe10bd-e811-4a6e-a89d-81757213c6e1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436141 Nov 08 04:37:51.702254 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0cb9849-caf2-4f57-a2c4-7412ee12ec75 req-8daae559-26dd-4c11-b13a-3374acaf0aaa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:51.703710 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b0cb9849-caf2-4f57-a2c4-7412ee12ec75 req-8daae559-26dd-4c11-b13a-3374acaf0aaa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0475936 Nov 08 04:37:51.750798 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b0cb9849-caf2-4f57-a2c4-7412ee12ec75 req-0c4e18fd-10a5-4bb8-bcdf-10c452db14e4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405552 Nov 08 04:37:52.867495 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b16c9ce0-3aac-46da-9fd7-8d9a1b06d182 req-1ede5aaf-bbfc-4913-b5cc-110bfeadd8d8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:52.868849 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b16c9ce0-3aac-46da-9fd7-8d9a1b06d182 req-1ede5aaf-bbfc-4913-b5cc-110bfeadd8d8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0474951 Nov 08 04:37:52.913792 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b16c9ce0-3aac-46da-9fd7-8d9a1b06d182 req-3c406ef2-3245-4331-89ba-0b1d7207ac2e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390127 Nov 08 04:37:52.933468 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:37:54.030368 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78b01885-5187-483e-a7c7-26f7749e2e52 req-f514eab9-2dae-4841-a9b4-471ea9e5912d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:54.031833 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-78b01885-5187-483e-a7c7-26f7749e2e52 req-f514eab9-2dae-4841-a9b4-471ea9e5912d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0515049 Nov 08 04:37:54.076516 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-78b01885-5187-483e-a7c7-26f7749e2e52 req-6ddc8ab3-7140-45b6-82ce-11df897fcf9e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391371 Nov 08 04:37:54.444323 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:37:55.188156 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79f0d40-3b27-4894-8d97-29c5566ef712 req-f61428fd-571e-4979-bbed-b58512297c10 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:55.189559 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f79f0d40-3b27-4894-8d97-29c5566ef712 req-f61428fd-571e-4979-bbed-b58512297c10 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0470183 Nov 08 04:37:55.236545 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f79f0d40-3b27-4894-8d97-29c5566ef712 req-45b1b750-43e9-49d5-ac42-1dfb68411b7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409806 Nov 08 04:37:56.348340 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50836c1-c79c-4ca1-8ed2-b5cb4f250260 req-a195bb01-4af4-4544-9e88-071332d07368 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:56.350008 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d50836c1-c79c-4ca1-8ed2-b5cb4f250260 req-a195bb01-4af4-4544-9e88-071332d07368 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0468163 Nov 08 04:37:56.399607 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d50836c1-c79c-4ca1-8ed2-b5cb4f250260 req-0789d9ab-65d4-4acc-80b1-acd311eae904 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439413 Nov 08 04:37:57.511990 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b0e986a-3315-4a52-9685-b73bb312329d req-52528edb-df0c-46f8-809a-4c91bfcad384 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:57.513451 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b0e986a-3315-4a52-9685-b73bb312329d req-52528edb-df0c-46f8-809a-4c91bfcad384 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0472641 Nov 08 04:37:57.559011 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b0e986a-3315-4a52-9685-b73bb312329d req-8cd83f62-1e9d-4885-8064-69ff411708bb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390375 Nov 08 04:37:58.672203 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcbb477-bfa7-4b1a-b164-9ad04fca42cf req-6e80c678-7b81-445d-bdee-47dbf8104c4c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:58.673643 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cdcbb477-bfa7-4b1a-b164-9ad04fca42cf req-6e80c678-7b81-445d-bdee-47dbf8104c4c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0477111 Nov 08 04:37:58.718718 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cdcbb477-bfa7-4b1a-b164-9ad04fca42cf req-7f8a4af2-922e-4f34-974a-127917f1a9a2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392234 Nov 08 04:37:59.834847 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccf6c20-c41c-4ffb-8b64-ea098a60abc5 req-336b1553-dc98-4c30-a012-7a4d96a05b14 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:37:59.836281 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6ccf6c20-c41c-4ffb-8b64-ea098a60abc5 req-336b1553-dc98-4c30-a012-7a4d96a05b14 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0507824 Nov 08 04:37:59.883551 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6ccf6c20-c41c-4ffb-8b64-ea098a60abc5 req-380334e8-ee11-4170-bd3b-946170609c59 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414371 Nov 08 04:38:00.996801 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78a27840-64d8-4d2c-94d7-cdaafa152ba7 req-da5d9b67-da99-4b72-9f52-1a4641fcc1ee tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:00.998253 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-78a27840-64d8-4d2c-94d7-cdaafa152ba7 req-da5d9b67-da99-4b72-9f52-1a4641fcc1ee tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0477293 Nov 08 04:38:01.043926 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-78a27840-64d8-4d2c-94d7-cdaafa152ba7 req-562f690b-6c33-4ed0-9066-f15fe4903914 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397246 Nov 08 04:38:02.156896 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e66cde8-427e-4b3a-a6de-fe11d3c8a3f7 req-3a6cf463-459e-4532-9589-2468112b2d71 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:02.158334 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9e66cde8-427e-4b3a-a6de-fe11d3c8a3f7 req-3a6cf463-459e-4532-9589-2468112b2d71 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0497425 Nov 08 04:38:02.204364 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9e66cde8-427e-4b3a-a6de-fe11d3c8a3f7 req-d70fd5e4-b89c-45e7-aab5-e75af418c21a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395954 Nov 08 04:38:03.318070 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4b73e8-ad8c-444d-9481-2ffa587dcf95 req-1379f09c-a06e-404c-ae4a-9146f41b3563 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:03.319528 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8c4b73e8-ad8c-444d-9481-2ffa587dcf95 req-1379f09c-a06e-404c-ae4a-9146f41b3563 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0481725 Nov 08 04:38:03.365096 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8c4b73e8-ad8c-444d-9481-2ffa587dcf95 req-eca79e73-e9bd-4cf6-bbb1-e8727336f82a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398448 Nov 08 04:38:04.476774 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c27ce38e-5ac2-4091-970a-731daf1d63a4 req-3e5dc831-31cf-498c-8e52-5a04550bc7ae tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:04.478231 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c27ce38e-5ac2-4091-970a-731daf1d63a4 req-3e5dc831-31cf-498c-8e52-5a04550bc7ae tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0476620 Nov 08 04:38:04.527320 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c27ce38e-5ac2-4091-970a-731daf1d63a4 req-78edec2f-5df8-4373-ba51-3fa0020384d4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432115 Nov 08 04:38:05.641249 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3901a06-76bf-499c-9f08-a918844cc631 req-be7ee84c-0ab5-49fc-8506-21d6951b5f5c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:05.642698 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a3901a06-76bf-499c-9f08-a918844cc631 req-be7ee84c-0ab5-49fc-8506-21d6951b5f5c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0476098 Nov 08 04:38:05.688294 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a3901a06-76bf-499c-9f08-a918844cc631 req-dcf8a108-6d04-4edb-a697-28ad05d375e8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391433 Nov 08 04:38:06.812623 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c98033f-a385-4289-9b1d-8dfb4b842bc4 req-a4945496-9d2b-4a7f-be54-24863b658f51 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:06.814071 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c98033f-a385-4289-9b1d-8dfb4b842bc4 req-a4945496-9d2b-4a7f-be54-24863b658f51 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0565732 Nov 08 04:38:06.860507 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c98033f-a385-4289-9b1d-8dfb4b842bc4 req-82a8b3e5-c589-48ba-a222-bbfb203710c1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402644 Nov 08 04:38:07.976416 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0815f2b6-1b21-4fd1-919a-e24e57e14084 req-15e641a5-95f2-4fd4-9e07-128bb249d5fa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:07.977910 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0815f2b6-1b21-4fd1-919a-e24e57e14084 req-15e641a5-95f2-4fd4-9e07-128bb249d5fa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0510585 Nov 08 04:38:08.023041 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0815f2b6-1b21-4fd1-919a-e24e57e14084 req-30c28178-798c-4749-bae3-05f1a0041bd1 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393264 Nov 08 04:38:09.134511 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d4bc3ae-f425-4d93-b737-ddb54c61390b req-7fb74b93-4fac-4bde-9ed4-20a92ee8d928 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:09.135991 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d4bc3ae-f425-4d93-b737-ddb54c61390b req-7fb74b93-4fac-4bde-9ed4-20a92ee8d928 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0477457 Nov 08 04:38:09.181604 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3d4bc3ae-f425-4d93-b737-ddb54c61390b req-2dc7d333-6524-42f3-a6c6-aad78f5187ac tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398951 Nov 08 04:38:10.292520 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa13857-cafa-4dd4-9f71-ce59ab52a97f req-08638c98-a0f3-473f-b6c4-d9b44adb1a3e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:10.293952 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5aa13857-cafa-4dd4-9f71-ce59ab52a97f req-08638c98-a0f3-473f-b6c4-d9b44adb1a3e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0472567 Nov 08 04:38:10.342744 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5aa13857-cafa-4dd4-9f71-ce59ab52a97f req-47907016-3e12-409e-a845-ea037f21d955 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431330 Nov 08 04:38:11.452645 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-818d3b83-0237-4287-af4c-383638a9f147 req-bdd38232-68c2-476c-ab27-1866cf4d7d48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:11.453990 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-818d3b83-0237-4287-af4c-383638a9f147 req-bdd38232-68c2-476c-ab27-1866cf4d7d48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0469780 Nov 08 04:38:11.499656 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-818d3b83-0237-4287-af4c-383638a9f147 req-c6e509fa-51dd-4e81-91e8-7c9eabec4d71 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390759 Nov 08 04:38:12.611258 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1068f32-380f-4aa1-89e3-95d4f480bc70 req-c9782075-f9fc-42c6-bf0e-e7b84d9495c8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:12.613304 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c1068f32-380f-4aa1-89e3-95d4f480bc70 req-c9782075-f9fc-42c6-bf0e-e7b84d9495c8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0483377 Nov 08 04:38:12.659141 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c1068f32-380f-4aa1-89e3-95d4f480bc70 req-995526d9-ef72-402e-9882-da4269c5e415 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393653 Nov 08 04:38:12.667475 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-ccf62c5f-54c2-4644-8b1e-b1a23899a0c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:13.776140 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79bd512-3480-45c7-88d6-6ea9abc91eee req-c82869b2-bb77-48b7-b900-053f7b9b9d66 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:13.777591 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a79bd512-3480-45c7-88d6-6ea9abc91eee req-c82869b2-bb77-48b7-b900-053f7b9b9d66 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0514007 Nov 08 04:38:13.823241 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a79bd512-3480-45c7-88d6-6ea9abc91eee req-21317d00-d82a-4daa-ba83-9bd6e1df77d4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398695 Nov 08 04:38:14.936863 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf201138-b204-435c-ba4c-ff6175dc0fd2 req-5263d16e-0f97-4590-822e-4051838b7350 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:14.938334 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bf201138-b204-435c-ba4c-ff6175dc0fd2 req-5263d16e-0f97-4590-822e-4051838b7350 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0484219 Nov 08 04:38:14.987204 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bf201138-b204-435c-ba4c-ff6175dc0fd2 req-87b188c6-630e-47c3-a285-8b0ab2a9b8c2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417197 Nov 08 04:38:15.124006 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c338607e-5e29-4494-abcc-04a4099cce5a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:16.078928 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:16.104676 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0aec371-5aa1-4467-8a49-63c79a04d809 req-2a2675ab-8567-45ce-93cf-719a2ece04f6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:16.106142 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c0aec371-5aa1-4467-8a49-63c79a04d809 req-2a2675ab-8567-45ce-93cf-719a2ece04f6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0518703 Nov 08 04:38:16.152002 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c0aec371-5aa1-4467-8a49-63c79a04d809 req-69e9535c-2ab9-4102-8f58-78b8d7f108ec tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399342 Nov 08 04:38:17.269810 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9c8a72b-65c9-4f25-95d0-e7433b1d8192 req-7d736c4f-2b4d-465e-b593-f72f1aea7653 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:17.271345 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9c8a72b-65c9-4f25-95d0-e7433b1d8192 req-7d736c4f-2b4d-465e-b593-f72f1aea7653 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0478473 Nov 08 04:38:17.317537 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9c8a72b-65c9-4f25-95d0-e7433b1d8192 req-d4d6b74e-9d4d-499d-ac9d-7e9cf294a2ae tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404899 Nov 08 04:38:17.752968 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:18.430286 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5908ffdc-cea0-4df1-acb8-d1ec35cabeb9 req-20801cae-583a-40bc-b295-4a5d1b1b47f8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:18.431792 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5908ffdc-cea0-4df1-acb8-d1ec35cabeb9 req-20801cae-583a-40bc-b295-4a5d1b1b47f8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0480669 Nov 08 04:38:18.442728 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:18.481534 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5908ffdc-cea0-4df1-acb8-d1ec35cabeb9 req-1ada8a68-aa13-4c0d-820c-dd66d2a4eaf7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438108 Nov 08 04:38:19.594245 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5912310b-e2aa-4c43-af0c-c9022723e729 req-d939207e-2a64-4908-9708-8cc7ec005d42 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:19.595757 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5912310b-e2aa-4c43-af0c-c9022723e729 req-d939207e-2a64-4908-9708-8cc7ec005d42 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0485294 Nov 08 04:38:19.642273 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5912310b-e2aa-4c43-af0c-c9022723e729 req-067617b1-0980-4898-abf6-bfe2ef064348 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405536 Nov 08 04:38:20.754345 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b69bb58-187b-479d-9c45-781771d75746 req-0f5b96e5-7b87-4c9f-b1ef-039bda41b6ec tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:20.755790 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b69bb58-187b-479d-9c45-781771d75746 req-0f5b96e5-7b87-4c9f-b1ef-039bda41b6ec tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0476537 Nov 08 04:38:20.800877 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b69bb58-187b-479d-9c45-781771d75746 req-50af5aea-5489-426e-a1d2-a97de2f2acd9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393429 Nov 08 04:38:21.917536 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29425ade-6c41-4552-9012-150326954abd req-2702e342-9a38-44d9-8562-f176be531fb4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:21.919021 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-29425ade-6c41-4552-9012-150326954abd req-2702e342-9a38-44d9-8562-f176be531fb4 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0517089 Nov 08 04:38:21.965106 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-29425ade-6c41-4552-9012-150326954abd req-1ea54fb3-7ceb-462b-baae-da9c02914ab6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399182 Nov 08 04:38:23.078863 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67baec0f-28ec-4da2-9008-935bec0c1243 req-5e3f0bac-5472-48a8-87d9-e383bc88e9fd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:23.080651 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-67baec0f-28ec-4da2-9008-935bec0c1243 req-5e3f0bac-5472-48a8-87d9-e383bc88e9fd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0496018 Nov 08 04:38:23.127404 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-67baec0f-28ec-4da2-9008-935bec0c1243 req-3ab97686-1ffc-427a-b884-b858979d2808 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409484 Nov 08 04:38:23.955668 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-7215787d-2363-4ec9-8e5f-e76c1982eea5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:23.957711 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-7215787d-2363-4ec9-8e5f-e76c1982eea5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.16 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0503492 Nov 08 04:38:24.044467 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Deleting port eac4c3f2-b319-465e-9c3f-59ea0259a2a3 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:38:24.044806 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:24.129082 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] For port eac4c3f2-b319-465e-9c3f-59ea0259a2a3, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,segment=NetworkSegment(a422b515-4eaf-4235-a3e4-a2fa0790f882),segment_id=a422b515-4eaf-4235-a3e4-a2fa0790f882)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:38:24.129770 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:24.145225 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Calling delete_port for eac4c3f2-b319-465e-9c3f-59ea0259a2a3 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:38:24.256585 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22939adc-b987-4650-a3b0-a25599b5f1f5 req-630d8ab2-8144-4aae-aa16-d0af23d9d017 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:24.258056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-22939adc-b987-4650-a3b0-a25599b5f1f5 req-630d8ab2-8144-4aae-aa16-d0af23d9d017 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 945 time: 0.0629983 Nov 08 04:38:24.338644 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-22939adc-b987-4650-a3b0-a25599b5f1f5 req-7055bbdf-622f-489f-b2f1-a8ccc4857274 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/security-groups?id=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747015 Nov 08 04:38:24.386410 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:24.414971 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Pushing event deleted for resources: {'Port': ['ID=eac4c3f2-b319-465e-9c3f-59ea0259a2a3,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:38:24.423619 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] get_ports_and_sgs() called for port_ids ['eac4c3f2-b319-465e-9c3f-59ea0259a2a3'] {{(pid=101666) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 08 04:38:24.427472 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.430349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.430349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.430349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.430349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.430349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.430349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.430349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.430349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.430349 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.431206 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.431206 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:38:24.463426 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] No DVR routers for this DVR port eac4c3f2-b319-465e-9c3f-59ea0259a2a3 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:38:24.465828 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:24.469097 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-acbf858c-52be-4210-9b1f-a33a7576a119 req-18e30c68-2fbc-4c8f-9c38-5ab034db5f48 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.16 "DELETE /v2.0/ports/eac4c3f2-b319-465e-9c3f-59ea0259a2a3 HTTP/1.1" status: 204 len: 173 time: 0.5058010 Nov 08 04:38:24.469535 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7e227364-ee79-4f7a-94c6-fca4e0bd3c6d', 'name': 'network-vif-deleted', 'tag': 'eac4c3f2-b319-465e-9c3f-59ea0259a2a3'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:38:24.471766 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0022ac09-c0c5-47ee-9a26-b2af2e7f823e" -d '{"events": [{"server_uuid": "7e227364-ee79-4f7a-94c6-fca4e0bd3c6d", "name": "network-vif-deleted", "tag": "eac4c3f2-b319-465e-9c3f-59ea0259a2a3"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:38:24.479353 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:24.568578 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:38:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d319b32-e404-4798-97b5-8bb3d525f59f x-openstack-request-id: req-2d319b32-e404-4798-97b5-8bb3d525f59f {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:38:24.568872 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7e227364-ee79-4f7a-94c6-fca4e0bd3c6d", "name": "network-vif-deleted", "tag": "eac4c3f2-b319-465e-9c3f-59ea0259a2a3", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:38:24.569153 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-2d319b32-e404-4798-97b5-8bb3d525f59f {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:38:24.569553 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7e227364-ee79-4f7a-94c6-fca4e0bd3c6d', 'name': 'network-vif-deleted', 'tag': 'eac4c3f2-b319-465e-9c3f-59ea0259a2a3', 'status': 'completed', 'code': 200} Nov 08 04:38:25.431476 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ddbb8aab-758f-4305-8272-78478665bdda req-ed456da4-d246-468e-bcd4-a8e13f81686a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0262518 Nov 08 04:38:26.528266 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1096e257-1b10-4b27-8ec5-fdebb83cad4e req-4dd8fe2d-68ce-4e19-bf1d-d279536e84cd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0290251 Nov 08 04:38:27.262322 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device eac4c3f2-b319-465e-9c3f-59ea0259a2a3 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:38:27.281561 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: eac4c3f2-b319-465e-9c3f-59ea0259a2a3 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:38:27.281900 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device eac4c3f2-b319-465e-9c3f-59ea0259a2a3 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:38:27.623921 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2e864f1b-053b-4660-88ce-fd3c1b66441d req-73aecfb9-9a0c-4dec-989d-4c8881043c10 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0292726 Nov 08 04:38:28.716314 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b493d087-a5d8-44b5-8c97-af713a34eb99 req-70af1863-a094-4898-9d7a-d70ed73efc4a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0258782 Nov 08 04:38:29.809099 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c939d28-a57e-4900-a632-6e6268a053e4 req-66c063dc-fbd3-4f24-820b-a3c01aa15e6e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0259805 Nov 08 04:38:29.935886 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:38:30.899448 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c84e7bc-7012-4df9-b6de-1964c11b0ecc req-63e260d1-27f5-4240-826b-3abd69075d3d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0260086 Nov 08 04:38:31.995019 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5458138f-7b6e-4ead-b3d2-07fbf0177984 req-d068a097-edbe-4006-adcc-7cc7910ebddc tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0258796 Nov 08 04:38:33.088338 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e7e8c474-1419-4d92-9166-88d775fe4db5 req-eea43c87-6e57-45e9-b33d-84981c0e3cf7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0288780 Nov 08 04:38:34.178686 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-55d3555d-353a-46fc-8b51-0c5682c06534 req-993b50b4-97d4-4c1c-a052-2da9afc840fb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0249789 Nov 08 04:38:35.270776 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b87a1b28-35c8-4fe0-b8f2-c7de35769138 req-e3a3c93a-3fbc-479e-a8d7-e645353fd4d0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0257230 Nov 08 04:38:36.362114 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-237e36be-5e2e-4da5-9929-439f7a00bff3 req-4cb1b3d1-5f4e-4770-8a35-3ed729b93acf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0247331 Nov 08 04:38:37.453163 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a141d3f0-d7f1-42da-90ac-7d2d302c7c3e req-14ab9e4c-f5d2-44ae-9492-41caf666db96 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0255935 Nov 08 04:38:38.544214 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e25813b4-fa1f-4c68-a4ed-faa06821a3fe req-f1364ac7-0ef8-403f-bc89-8491364ea641 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0259037 Nov 08 04:38:39.639810 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-79b638bf-4791-4238-822c-9dcf6b8e3f69 req-6b1daf58-79f5-461a-b7ea-e1ccf90101db tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0286222 Nov 08 04:38:40.730932 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5ecb57d-3aaf-4c72-bdb6-9833cbe9c73e req-a1f3ec55-9ceb-42be-a26e-1e4f5c5244f9 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0248482 Nov 08 04:38:41.822272 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc4eb5dd-6702-4878-9b4e-0e27daf05c6f req-105711a9-93d5-4095-9b16-c39941841706 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0257151 Nov 08 04:38:42.665976 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-87ed6486-f9e1-4d4e-a411-3dea4d99fd96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:42.912178 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2dba94b2-d155-4c6a-928a-41a01b504267 req-d32c02b0-13c1-4a1c-a3c1-11d7016c6a09 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0248156 Nov 08 04:38:44.008707 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-efaf82dc-1314-41d7-812d-cb1e2c132c66 req-5b41d484-211b-455e-b9dd-11f48303923f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0293546 Nov 08 04:38:45.104941 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5d526b9b-357c-4b6e-90d7-9fa482010eae req-eb18af6a-fa92-4008-89dd-38df18c0004d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0268915 Nov 08 04:38:45.151645 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1730eef6-dc93-4755-87e0-1a914fc11f1f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:46.087917 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:46.201550 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1a741097-2c26-42e5-9fae-1f13e2587add req-71ecb868-a977-4296-b07b-157fa24c035e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0291576 Nov 08 04:38:46.211237 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-a5063bb1-615b-449f-9598-522538821532 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0654705 Nov 08 04:38:46.308563 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-771e6d59-eb9d-4930-8f94-464bfd27f330 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:46.309996 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-771e6d59-eb9d-4930-8f94-464bfd27f330 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0401144 Nov 08 04:38:46.411139 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-6f06f70a-9295-42a2-9477-19b042decf07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:46.412558 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-6f06f70a-9295-42a2-9477-19b042decf07 service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0842850 Nov 08 04:38:46.474931 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-d797e48a-a469-487d-bf7f-e3e9bda54eb3 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0557544 Nov 08 04:38:46.521990 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-07e6ae52-f94c-460e-bca2-6e371dd3b439 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:46.523404 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-07e6ae52-f94c-460e-bca2-6e371dd3b439 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0414371 Nov 08 04:38:46.571050 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-8ecd19ca-8a98-4f7a-b58f-2af4df836319 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:38:46.572401 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-8ecd19ca-8a98-4f7a-b58f-2af4df836319 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0416987 Nov 08 04:38:46.660654 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-3db19fa5-f6c4-4b39-9047-7ee3a7f77abf service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811288 Nov 08 04:38:46.749975 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58a51d3f-f482-4241-bc23-48af3d1f8a8a req-39aa4d84-31b4-4b14-a330-7192eebf8d32 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820243 Nov 08 04:38:47.293936 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1cb82e43-314a-4bda-8eb1-3eecc0076e89 req-e7e4e1ca-77bc-4201-9465-e8a7d61d4412 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0252278 Nov 08 04:38:47.734767 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:48.386902 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6492decb-6034-40f4-aef1-4af81091aede req-294c7dbb-3c2a-47b3-9e30-82e16b9c3537 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0254617 Nov 08 04:38:48.425311 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:49.478563 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-28dc3bc3-f593-4ab3-827f-5091bbe99503 req-69952a51-b449-4fc9-b4d8-5282007a5aac tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0256445 Nov 08 04:38:50.574050 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-77cc75a3-a924-4a9c-bb85-06361968b46a req-4567ed14-57ab-455f-9d56-79986c7b2f9d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0294688 Nov 08 04:38:51.668092 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cd0b0486-4c58-4e2e-bbd9-fc41335edeb6 req-5e4e0c2d-086e-4e02-8d9c-9c20df9ce937 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0269873 Nov 08 04:38:52.759690 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3c3f8b61-c9e0-4bb1-b820-5d227b2eaace req-8e043838-3886-483b-88d2-18c5e6352289 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0250750 Nov 08 04:38:53.851624 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-725427d5-e0b5-44fc-a4bf-1bef123f8582 req-f85954d3-4d4c-4c16-b962-10ee17024d54 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0257876 Nov 08 04:38:54.471826 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:38:54.941978 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df61715c-5065-4bb2-90a0-46c55aae9f53 req-4d8fdabb-f19e-4b35-a261-09474124d3a3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0246861 Nov 08 04:38:56.033631 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f93345cd-be13-4a72-afc2-ced5b5ff82d4 req-6b5d355e-9d47-4963-8202-9b0b0e0add69 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0246937 Nov 08 04:38:57.137394 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-69167b57-54d2-4b36-8f68-69d8ba634f3d req-40f0484e-769c-4f9b-9581-89759728f9ca tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0289042 Nov 08 04:38:58.228577 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-86de1ddb-e161-49fb-aef5-330587c5e3da req-41d002fd-801a-4b20-b5b5-be03411ea04b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0255129 Nov 08 04:38:59.319559 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f64019f-46b9-4dea-bab2-b9a9294712e9 req-015829d5-a54d-448f-9cde-f1f3011a5e9a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0260804 Nov 08 04:39:00.411428 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-50528ba3-1cc9-4b85-aced-ee8280673407 req-bc2010da-6650-4069-9820-bd07c926ac73 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0255206 Nov 08 04:39:01.503172 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8ec878e3-ac1c-4436-9503-6dd1f24f7f24 req-93e782b7-f46b-489f-bf42-3756d7d3efe0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0256803 Nov 08 04:39:02.594750 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bf9098e9-0d97-46ac-a2ab-108d25ea6f8b req-0a84a94b-a69c-450c-a997-e563e951884d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0256715 Nov 08 04:39:03.690022 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-201f0820-eecd-4df9-ae32-61eae465595c req-8d7c7860-5543-4066-b8ea-4fcb86e20a90 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0284779 Nov 08 04:39:04.781679 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d1b8839f-f4d2-4c9e-92a5-cfbeb033c592 req-e5be6046-0925-4d91-987f-e050053d9fb6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0247362 Nov 08 04:39:05.875515 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9bc91d23-dd4d-4cee-9de5-3be85e278c05 req-b4c531aa-26e9-4543-8ca0-a5df4560d189 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0261009 Nov 08 04:39:06.935440 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:39:06.969871 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-098029e4-11f4-49bc-a567-b3977cfa5844 req-ce3af84c-f48e-4c5c-aed5-1f9903e6ea34 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0252161 Nov 08 04:39:08.062149 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a4d62be3-485c-4a24-aa58-dd01dc176df0 req-c21a06d9-54fb-4bd2-a4ee-95356416820d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0253522 Nov 08 04:39:09.154047 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fc757b67-3733-4238-be70-a73af72b6462 req-c444c3c9-3795-4a65-a248-2a91e2f8d2c3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0251505 Nov 08 04:39:10.247894 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-775bfaa1-6406-4d23-a083-df8cb1d60772 req-58e7f0eb-287b-44b7-9a16-6fa9d836677a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0277889 Nov 08 04:39:11.338966 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-985363be-8cb8-47cf-8b04-ddbc8e0b74e8 req-f542c3f3-6333-4ffb-8e24-45f3a96e332c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0258741 Nov 08 04:39:12.430988 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-beecdf23-660b-48b5-9075-1cc53240c342 req-b6a81d50-8240-49bc-8763-c5f68ae50d6b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0251482 Nov 08 04:39:12.698642 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-81700b61-422e-4ae7-97bb-072a93b845db None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:13.522930 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3eda0688-a82b-4f87-947c-29bcfcb33c5f req-86b5f073-c745-49dc-b271-3712a377f474 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0256722 Nov 08 04:39:14.613555 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a16d05c9-c2fd-4b77-9384-5c17e2137195 req-7a7aea58-e5e6-4592-8f5a-6f4fde8a93e7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0248363 Nov 08 04:39:15.156791 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-62293acc-1781-42f3-982d-e5596f36340f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:15.706341 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-efcd9ec6-8772-45e8-9c3e-84cf0afe4384 req-d6a6b253-dee6-4b2f-b1f1-46c011d07987 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0257559 Nov 08 04:39:16.071120 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:16.801745 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-05fe7b4b-9653-4dc5-9b59-4bd5e3f46807 req-b9895609-6c2a-46a7-a1d7-bf5ae4bb592a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0291045 Nov 08 04:39:17.738373 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:17.893468 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-22eb0ac8-e0b2-41ac-854b-fb6bb28dc1d4 req-f2f9f014-b065-4ea7-9828-ccbc35b38e09 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0255177 Nov 08 04:39:18.419549 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:18.984572 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f02cc011-fcbc-4695-9423-d28092b0027e req-2110380a-8f83-4a1b-a54e-8c595b3b7a86 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0252457 Nov 08 04:39:20.074149 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-56fcdf90-f9e5-45a5-87ee-ec0b9882f4f3 req-aa71e2af-c9f5-4061-8111-57b0c4db6c7c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0255959 Nov 08 04:39:21.166338 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bd1fbde4-b1f9-44a1-b29d-752b02a52c1a req-7b8b2c2f-2a5d-4235-8b7e-c00f7cb225e7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0261769 Nov 08 04:39:22.304642 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-96a6a7e0-1a83-49f3-b445-e91ee0679a14 req-fff846e8-35e3-42d4-b516-f0465aa0a58f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0726094 Nov 08 04:39:23.446557 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-59dbbf3a-ebf7-4e0a-b84c-786396fe88e9 req-afccd4e3-a477-453f-94fb-113de05be631 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0765116 Nov 08 04:39:24.493956 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:24.538127 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-de2eedca-9c17-4d89-994b-c27ef24947b4 req-b1a6279f-8156-443e-a02b-eabd6d129faf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0257883 Nov 08 04:39:25.629562 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-06e4cef4-14b2-4d82-9731-1203ba11f027 req-60dda51c-6c62-4867-aa1f-20cf52cfaebd tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0250056 Nov 08 04:39:26.721344 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9164b7eb-70ae-48c4-869d-d52265048292 req-ecdb3954-e29e-4c91-a4a8-2c1be6c14419 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0260119 Nov 08 04:39:27.813048 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e49e5ef6-a2d5-40c8-8946-eba3b8269386 req-670d45ba-b711-4a81-8e36-06e38b038f7e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0259840 Nov 08 04:39:28.905289 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b24e71d7-a887-4153-86f2-4e83dcb7b56c req-0b01dea1-29d6-4713-92f4-505900329a6e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0251431 Nov 08 04:39:30.008138 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6f1352d-2ebb-4141-a1f3-36ea6e994680 req-4712d12b-f06f-44b3-91bd-bd51d350533a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0287089 Nov 08 04:39:31.100844 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85cf1593-7d72-4fd4-a360-dc1c8329150b req-d1be1c31-0a56-489a-83f6-06895a0c9c75 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0258167 Nov 08 04:39:32.193731 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a3c7c5d5-6fba-4ecb-8189-378e4c89d523 req-67da0fda-f297-4e86-be34-e8aef164e7bf tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0280302 Nov 08 04:39:33.292660 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4d76c8d0-0ca1-4560-bdc5-04ac58774b4d req-a031df17-0767-4309-99d2-617217858411 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0260243 Nov 08 04:39:34.384623 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3c19f61d-b0a9-4a92-9ce1-9a6071802667 req-08441da8-c253-47b4-8de1-42f53b126901 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0259814 Nov 08 04:39:35.475410 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4a7ed073-e366-454c-a81a-0bb629977c6b req-5c8258e8-8901-4048-9580-4eb9d2894ebe tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0249071 Nov 08 04:39:36.567446 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c31a92bb-cdc3-4d03-ada3-49faab9885d9 req-e69951a1-d3f8-4f77-9232-1aef27b92d2f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0281982 Nov 08 04:39:37.662737 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7e85974a-919f-43c7-b523-3a453acb73bd req-39e80554-a1fd-4823-946b-48c8e9ba7beb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0248942 Nov 08 04:39:38.755281 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ca4dfe27-6b7a-461c-815a-7d6d485b3ba9 req-377d47fa-66aa-4bdf-bce6-e4165eccf96f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0256252 Nov 08 04:39:39.847953 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e915f196-22a4-45f7-91f9-1a27babbdba7 req-9a8b8ece-b3e1-4d3f-b8a1-f8c605d1faf8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0251441 Nov 08 04:39:40.937823 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5eb3b95-826d-440c-9d37-95229bf1eee4 req-c8d4adb8-9c7a-4b23-8de2-775d6959cac8 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0246584 Nov 08 04:39:42.028789 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1ea825c-5c14-486b-9682-beeea65986db req-fe5685e7-70d2-478f-a12e-023aad719fb0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0252290 Nov 08 04:39:42.670022 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-53912775-54fe-4e8f-9dc8-79917c0673a9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:43.123165 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3f772eac-a3f7-40bb-8ead-6edccd3899b1 req-16b51c60-2629-4828-90df-09c709eb5691 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0277712 Nov 08 04:39:43.933682 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:39:44.216516 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-112699a5-491a-470f-85a6-64c805bfcf1b req-cfb5a828-aed0-4289-83df-1eba21cf3e37 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0255775 Nov 08 04:39:45.155913 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7302bfd7-6ddd-4582-a745-6291bfbbaa12 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:45.310347 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ecdbaba9-ca23-4494-be5d-c9c63218ea6e req-7a8156fd-dbed-4b58-b6da-dfb30788b7b0 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0249991 Nov 08 04:39:46.070010 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:46.404148 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e3a49ae4-083e-4be9-94b0-dff2a8dd12b3 req-22357983-40ad-4786-baf4-c47ae78c3a8e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0255940 Nov 08 04:39:47.495106 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-abee4960-4455-448d-b01c-f3d947f82163 req-a5946864-77cf-4c71-b29f-e33dc7f7f800 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0254951 Nov 08 04:39:47.738390 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:48.229247 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-5c937cdb-ee01-44eb-8fe7-00a3e03ae410 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0389693 Nov 08 04:39:48.332843 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-2770a1fc-318e-455d-870b-287b60464057 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:39:48.334306 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-2770a1fc-318e-455d-870b-287b60464057 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0473549 Nov 08 04:39:48.423145 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:48.434398 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-abbd4e09-2433-40ad-988a-aa1cb35dfd80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:39:48.435897 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-abbd4e09-2433-40ad-988a-aa1cb35dfd80 service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.0821025 Nov 08 04:39:48.503078 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-bf0b692a-b97d-4ba2-8d1d-02489f7d52a2 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 1001 time: 0.0597882 Nov 08 04:39:48.552010 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-43a7a51e-c63c-4e6a-970a-c89625261f72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:39:48.553447 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-43a7a51e-c63c-4e6a-970a-c89625261f72 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0440657 Nov 08 04:39:48.604225 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8071b0e6-f604-4ab2-a2d8-db297e6f13d6 req-3ea9f94e-f222-4526-8ef6-51e99e20f4d6 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0358100 Nov 08 04:39:48.618290 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-1ed4a03c-2762-4f8c-84c2-d328a27e4c38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:39:48.619919 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-1ed4a03c-2762-4f8c-84c2-d328a27e4c38 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0595663 Nov 08 04:39:48.708587 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-76b92ceb-6dde-43a2-846a-04587fed6e71 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812364 Nov 08 04:39:48.796397 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bb5bbc40-f14c-4fe3-aaad-f4448d96b3de req-76b62fe8-1955-493c-97bc-9e765191037e service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0807538 Nov 08 04:39:49.694613 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7de8c7c6-2e36-4dc9-91d1-ab01c5350bad req-d22a8296-16f0-4767-8144-c4ca3fef0d26 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0248523 Nov 08 04:39:50.785472 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bd739398-c901-4065-b3ba-e9c5af7f1ae2 req-6466ca70-0fbd-4500-813f-a6bf6f37185f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0252144 Nov 08 04:39:51.875890 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c40aec4-8de9-4974-a2a8-72c4fee00f99 req-4e961d8d-8a7c-4175-bc29-6096e48d5a1d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0252280 Nov 08 04:39:52.967159 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-04cfc69a-7766-49cc-a2c5-93d7a4ec5e5a req-287bf375-fb04-43c4-9f45-5683df1edf17 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0257454 Nov 08 04:39:54.061965 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48d8c914-a956-4f94-83fa-25a912b2ceb9 req-f9109d04-22a3-49f1-a4fe-d146f8d75de3 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0302532 Nov 08 04:39:54.470072 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:39:55.156809 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2bcc957e-9704-4067-82ff-ab2230cad84e req-49273474-71cd-406e-a682-2d6b9421186a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0278783 Nov 08 04:39:56.248547 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f10ac360-fafe-4cfb-acff-de3791fdf753 req-b767dbb3-e3a9-4554-8ed6-abb4956dd137 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0250983 Nov 08 04:39:57.339832 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-02a5acb8-526b-45d8-b001-575eab653cce req-543d9704-fac8-4508-8f7b-35bde7fbc65b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0247960 Nov 08 04:39:58.432311 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4365ac9a-30f4-4071-ac34-e24ad199bef8 req-3d63bb65-949f-48c0-b83c-146395b9372f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0257690 Nov 08 04:39:59.524137 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dddb5a9a-7b94-4f1b-81ae-096a80aa1b57 req-9a6b71b7-5703-4946-ae01-50a46c9cfe44 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0255203 Nov 08 04:40:00.616108 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c28810c7-41b1-4095-a423-67ad2f3fd116 req-8b5cb890-eb74-413b-8f35-260aea2076fa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0257666 Nov 08 04:40:01.710181 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4511a372-78b6-4ad5-8464-f84b3444ae76 req-18e00f7e-aef3-49ca-9a00-ba7f6359983f tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0287619 Nov 08 04:40:02.809967 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-574a8ab2-272a-41c4-beb0-f90e72492f89 req-ad2e9ed3-2d0e-4720-8078-ff7664a4b2fa tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0261970 Nov 08 04:40:03.901934 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-994001f6-a636-48bb-82b6-a3952068bbf9 req-53ec14f8-2d8c-43a3-9de3-357c32680f30 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0253708 Nov 08 04:40:04.992438 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0c33612b-f46a-43ef-8a1a-6944fd367eb6 req-69447d5b-a651-4233-91fb-0d7601c39240 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0259278 Nov 08 04:40:06.083322 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b2c8d048-d313-4a76-95f5-5d76050f7aae req-ef9e683e-1d74-45e9-ab6c-daabfc69e2b5 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0255775 Nov 08 04:40:07.175424 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-39011976-364b-45a3-9481-c87792dfc907 req-dab14bed-d33e-464f-bf19-c6f86e82deb2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0260270 Nov 08 04:40:08.270966 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-59fd7a43-90c8-492a-896f-2b9ae6753917 req-e5177cd7-0c21-4196-91b2-418d3bc365f2 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0278504 Nov 08 04:40:09.360475 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1f4cf68f-ccf2-4e7f-94e0-0b3bbfa753d5 req-df99eaa4-d75c-4583-bb90-864a119a3c54 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0251086 Nov 08 04:40:10.451313 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98e9a442-45dc-4af1-b9d6-ee5265d349d3 req-8c857518-edba-4832-b677-8a059fb4923d tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0246501 Nov 08 04:40:11.542988 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b61312f0-2f92-4ddc-b7ad-11c64cf97516 req-1d2c1bef-e668-4ba5-89c4-a39d24da414e tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0252168 Nov 08 04:40:12.637342 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5068493f-dc33-412f-b62a-6439b06efb27 req-d6fc7dea-f8be-4d34-921e-c6a141d527c7 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0257604 Nov 08 04:40:12.669747 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d0fde95d-61ce-43ee-a7da-864ba91ae4f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:13.728604 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-27c983ed-f669-4b62-9f6c-9fe268886163 req-24cea90e-cc5b-4b2e-884d-c6454de8441a tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0259268 Nov 08 04:40:14.822886 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5e903e8-8958-4bea-9725-64b6f4b89d5f req-cb65f0c7-2b1b-48f4-bf1d-310724e2d877 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0278206 Nov 08 04:40:15.191295 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-565ccffa-2ee9-4e44-9e51-7658f225f1ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:15.915613 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f0663a13-2d8f-49a5-9a6f-df257727b5fe req-59697962-e658-470f-802b-6af6acc9f63b tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0262241 Nov 08 04:40:16.108115 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:17.014286 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9297fbc1-610d-46dc-8506-d429d0f9246e req-c8fb75ab-f4cf-4b9c-ab61-5a63236ca508 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0316136 Nov 08 04:40:17.732463 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:18.108324 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-010fd768-b14f-4922-8428-5adab49a2324 req-7dfcef70-1ee6-4c22-bd7b-c26012823941 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0253696 Nov 08 04:40:18.423738 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:19.199723 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9aca99fa-d40c-4b08-b750-ba44894699a7 req-c5d94744-a514-49ff-a91f-f643dae4f7eb tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0248723 Nov 08 04:40:20.290237 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a79e8087-8180-423a-bebe-a3e460772612 req-70775593-5539-4b5a-841c-62976102ea0c tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0249219 Nov 08 04:40:20.325373 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 35568) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:40:20.479092 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Deleting port 7c0b0bd5-cf88-4040-b07f-e65b8412df0e {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:40:20.479348 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:20.549987 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:20.550299 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:20.561365 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Calling delete_port for 7c0b0bd5-cf88-4040-b07f-e65b8412df0e owned by network:floatingip {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:40:20.766437 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:20.791160 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event deleted for resources: {'Port': ['ID=7c0b0bd5-cf88-4040-b07f-e65b8412df0e,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:40:20.802805 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.803161 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.803507 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.803847 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.804181 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.804513 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.804842 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.805171 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.805501 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.805824 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.806146 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.806465 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:40:20.861408 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:20.861732 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.db.l3_db [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Floating IP 00ce2f97-4322-45b8-8cd1-e53e8e1e43b6 disassociated (deleted). External IP: 172.27.2.47, port: 5ed549ab-2a42-442b-87e0-565478b5a012. Nov 08 04:40:20.932062 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:40:21.323721 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Router 8aa2c265-b728-4ac3-97de-f276d80d2037 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:40:21.403461 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ec16281b-f92d-47e5-aa88-67f4bc361f1b req-c5ffbb04-4a99-4524-8987-2f111dfd9b34 tempest-VolumesSnapshotTestJSON-1530594341 tempest-VolumesSnapshotTestJSON-1530594341-project] 10.222.0.21 "GET /v2.0/ports?device_id=7e227364-ee79-4f7a-94c6-fca4e0bd3c6d HTTP/1.1" status: 200 len: 210 time: 0.0393662 Nov 08 04:40:21.462907 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:40:21.468454 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:21.474056 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-607375fd-d068-494f-9e88-22f1653b247a None None] Sync routers for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:40:21.483156 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-607375fd-d068-494f-9e88-22f1653b247a None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:40:21.484007 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-607375fd-d068-494f-9e88-22f1653b247a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:40:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:40:21.502083 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-0de86f43-9c70-4320-8e8d-b944f5bcc880 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "DELETE /v2.0/floatingips/00ce2f97-4322-45b8-8cd1-e53e8e1e43b6 HTTP/1.1" status: 204 len: 168 time: 1.1718931 Nov 08 04:40:21.503161 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d56d482-c782-406d-84dd-036e79b29b4a', 'tag': '5ed549ab-2a42-442b-87e0-565478b5a012'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:40:21.506872 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fad667e6-b829-48bc-8b64-e780e09ad081" -d '{"events": [{"name": "network-changed", "server_uuid": "7d56d482-c782-406d-84dd-036e79b29b4a", "tag": "5ed549ab-2a42-442b-87e0-565478b5a012"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:40:21.570548 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 08 Nov 2021 04:40:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de7f2e16-70db-456e-b115-c866bd12266f x-openstack-request-id: req-de7f2e16-70db-456e-b115-c866bd12266f {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:40:21.570834 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7d56d482-c782-406d-84dd-036e79b29b4a", "tag": "5ed549ab-2a42-442b-87e0-565478b5a012", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:40:21.571084 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-de7f2e16-70db-456e-b115-c866bd12266f {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:40:21.571498 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d56d482-c782-406d-84dd-036e79b29b4a', 'tag': '5ed549ab-2a42-442b-87e0-565478b5a012', 'status': 'completed', 'code': 200} Nov 08 04:40:21.617396 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-607375fd-d068-494f-9e88-22f1653b247a None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:40:21.647797 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-4d19540d-1317-40b0-89e2-b274fe77a480 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:40:21.649286 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-4d19540d-1317-40b0-89e2-b274fe77a480 service neutron] 10.222.0.16 "GET /v2.0/ports?tenant_id=aa58a6fe20a449858977c517ca68518b&device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 1099 time: 0.0405951 Nov 08 04:40:21.756283 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-a148ac99-9aa3-4f60-8528-8fbce5446beb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:40:21.758017 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-a148ac99-9aa3-4f60-8528-8fbce5446beb service neutron] 10.222.0.16 "GET /v2.0/networks?id=16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 200 len: 913 time: 0.1002445 Nov 08 04:40:21.800011 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-594bc632-3cf9-42b5-b16e-4109ecabdac0 service neutron] 10.222.0.16 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 200 len: 217 time: 0.0345042 Nov 08 04:40:21.819304 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-607375fd-d068-494f-9e88-22f1653b247a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:40:21.851595 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-5fbd41ce-8a50-493b-bd9b-0fae7d2bea88 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:40:21.852733 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-607375fd-d068-494f-9e88-22f1653b247a None None] Checking router: 8aa2c265-b728-4ac3-97de-f276d80d2037 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:40:21.853091 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-5fbd41ce-8a50-493b-bd9b-0fae7d2bea88 service neutron] 10.222.0.16 "GET /v2.0/subnets?id=5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 200 len: 851 time: 0.0468359 Nov 08 04:40:21.862460 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-607375fd-d068-494f-9e88-22f1653b247a None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:40:21.867013 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-607375fd-d068-494f-9e88-22f1653b247a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:40:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:40:21.906165 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-b08a55a5-80be-4e72-bad3-832b517373e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:40:21.908044 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-b08a55a5-80be-4e72-bad3-832b517373e8 service neutron] 10.222.0.16 "GET /v2.0/ports?network_id=16cbde97-55ea-47f6-bd55-cf46e7c41a49&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0472512 Nov 08 04:40:21.986051 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-607375fd-d068-494f-9e88-22f1653b247a None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:40:22.036110 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb42754-e67d-4820-a1e8-5b1b19d826e0 req-bffb6895-3f3d-46c0-b406-8d74d0d41751 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:40:22.037656 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ceb42754-e67d-4820-a1e8-5b1b19d826e0 req-bffb6895-3f3d-46c0-b406-8d74d0d41751 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 946 time: 0.0952020 Nov 08 04:40:22.043080 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-9144f4bb-9c15-4736-8140-0e74bac4ad31 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248276 Nov 08 04:40:22.136240 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ceb42754-e67d-4820-a1e8-5b1b19d826e0 req-5b803747-e378-441e-817d-a4b7d7c67100 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/security-groups?id=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0922284 Nov 08 04:40:22.166774 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fad667e6-b829-48bc-8b64-e780e09ad081 req-6482ad0b-d0e6-4d93-a4fc-b2ae7a8cec57 service neutron] 10.222.0.16 "GET /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1093454 Nov 08 04:40:22.201139 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-607375fd-d068-494f-9e88-22f1653b247a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:40:22.227767 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-607375fd-d068-494f-9e88-22f1653b247a None None] The sync data for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi is: [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:14:23Z', 'revision_number': 4, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi', '_interfaces': [{'id': '4bdbd0d3-4329-4622-9ed1-490362f49e30', 'name': '', 'network_id': '16cbde97-55ea-47f6-bd55-cf46e7c41a49', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'mac_address': 'fa:16:3e:ad:07:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_interface', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:22Z', 'updated_at': '2021-11-08T04:14:29Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'subnets': [{'id': '5926063e-8f31-4623-9cfc-4a0b577bdb41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:40:22.432186 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f6d6e5a-d5e4-447d-a17f-5fd59d5251d0 None None] New status for floating IP 00ce2f97-4322-45b8-8cd1-e53e8e1e43b6: DOWN {{(pid=101667) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 08 04:40:22.697056 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beb10485-a78f-4332-8e04-88d11acf1239 req-8a13c947-9f12-464f-be36-0a459de6c777 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101665) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 08 04:40:22.698494 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-beb10485-a78f-4332-8e04-88d11acf1239 req-8a13c947-9f12-464f-be36-0a459de6c777 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 946 time: 0.0512130 Nov 08 04:40:22.787568 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-beb10485-a78f-4332-8e04-88d11acf1239 req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Deleting port 5ed549ab-2a42-442b-87e0-565478b5a012 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:40:22.787903 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-beb10485-a78f-4332-8e04-88d11acf1239 req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:22.874556 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [req-beb10485-a78f-4332-8e04-88d11acf1239 req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] For port 5ed549ab-2a42-442b-87e0-565478b5a012, host hv-cinder-78364, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78364',level=0,port_id=5ed549ab-2a42-442b-87e0-565478b5a012,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:40:22.874819 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-beb10485-a78f-4332-8e04-88d11acf1239 req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:22.887398 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [req-beb10485-a78f-4332-8e04-88d11acf1239 req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Calling delete_port for 5ed549ab-2a42-442b-87e0-565478b5a012 owned by compute:nova {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:40:23.069223 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-beb10485-a78f-4332-8e04-88d11acf1239 req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:23.098133 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event deleted for resources: {'Port': ['ID=5ed549ab-2a42-442b-87e0-565478b5a012,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:40:23.154017 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [req-beb10485-a78f-4332-8e04-88d11acf1239 req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] No DVR routers for this DVR port 5ed549ab-2a42-442b-87e0-565478b5a012 on host hv-cinder-78364 {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:40:23.154017 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [req-beb10485-a78f-4332-8e04-88d11acf1239 req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for port, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:23.154017 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-beb10485-a78f-4332-8e04-88d11acf1239 req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.16 "DELETE /v2.0/ports/5ed549ab-2a42-442b-87e0-565478b5a012 HTTP/1.1" status: 204 len: 173 time: 0.4468548 Nov 08 04:40:23.237419 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8e7c5846-675c-4d7a-8443-7d120935c9d6 req-bd75fc9d-6e35-4f9c-b1c6-cbde2a94f09b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0267889 Nov 08 04:40:23.572271 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d56d482-c782-406d-84dd-036e79b29b4a', 'name': 'network-vif-deleted', 'tag': '5ed549ab-2a42-442b-87e0-565478b5a012'}] {{(pid=101665) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 08 04:40:23.574659 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.21/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7613ab59b992980e5c662188445ff778f75e43a160bb625cddb2ff7ac6ca8b04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5a7a9ea-1d21-4349-936b-e66d93497b51" -d '{"events": [{"server_uuid": "7d56d482-c782-406d-84dd-036e79b29b4a", "name": "network-vif-deleted", "tag": "5ed549ab-2a42-442b-87e0-565478b5a012"}]}' {{(pid=101665) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 08 04:40:23.609642 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 08 Nov 2021 04:40:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f72a7f9-b197-4490-a85e-8e9e1029b56a x-openstack-request-id: req-7f72a7f9-b197-4490-a85e-8e9e1029b56a {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 08 04:40:23.609952 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7d56d482-c782-406d-84dd-036e79b29b4a", "name": "network-vif-deleted", "tag": "5ed549ab-2a42-442b-87e0-565478b5a012", "status": "completed", "code": 200}]} {{(pid=101665) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 08 04:40:23.610197 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.21/compute/v2.1/os-server-external-events used request id req-7f72a7f9-b197-4490-a85e-8e9e1029b56a {{(pid=101665) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 08 04:40:23.610609 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d56d482-c782-406d-84dd-036e79b29b4a', 'name': 'network-vif-deleted', 'tag': '5ed549ab-2a42-442b-87e0-565478b5a012', 'status': 'completed', 'code': 200} Nov 08 04:40:24.330067 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6107526a-8d2a-40e5-a1bc-c66b9aef0145 req-226235f9-caa6-4a28-b8fe-dc0b7b0da04e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251024 Nov 08 04:40:24.496138 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:25.423489 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-510bf147-0ab7-48b1-bff8-d6817a6b7a6a req-0e45cba2-2950-4b51-93c9-4d70fc99132e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252893 Nov 08 04:40:26.523061 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3513cf63-ff97-45b4-830b-9a32e163c120 req-d2a80660-16b0-415a-b0e6-a03a49f6324c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0292089 Nov 08 04:40:27.613655 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-14070ea3-a3bf-4dc7-90e2-084258152a2e req-dbd4c999-a86e-4415-90bd-e2b65d1da170 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255907 Nov 08 04:40:28.009966 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 5ed549ab-2a42-442b-87e0-565478b5a012 no longer exists at agent hyperv_hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:40:28.029367 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] No Port match for: 5ed549ab-2a42-442b-87e0-565478b5a012 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:40:28.029703 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Device 5ed549ab-2a42-442b-87e0-565478b5a012 not bound to the agent host hv-cinder-78364 {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:40:28.705309 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-328a4a64-642e-40ef-8150-a52713fe2d29 req-21372188-dbca-49b0-ac73-236cce7f3ac2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0261543 Nov 08 04:40:29.796096 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-46265c92-a5b4-43ea-8185-2a26ab367cc4 req-83d14922-d565-437d-b9f5-be953af110f2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254107 Nov 08 04:40:30.886292 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-13b798af-9200-4a45-8e6b-15dee7e6d4cd req-a6f864a1-6f22-407b-8444-91844e34bac2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0259535 Nov 08 04:40:31.976376 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-12a31d4e-3a1e-49fd-b515-7696cb9f91d2 req-8f0a0ddf-43cf-4fee-930e-44cd9f24b86e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252905 Nov 08 04:40:33.070644 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac42f93d-af03-43fd-871e-fa67a13bb553 req-944138c8-f781-4025-90a9-89b1597648cc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0279634 Nov 08 04:40:34.161043 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-969727b8-420e-4dca-934e-2620a73200c0 req-a2876252-95d8-473a-8263-ac92fc999516 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255582 Nov 08 04:40:35.250946 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3274e163-5d6c-469c-9cbf-f6b1bc4d2c7f req-a9a4b85f-273e-43bc-a68c-7b6c0eaecac9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0248852 Nov 08 04:40:36.341886 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2cb6ec31-5739-447f-bfa7-e4142a00e744 req-c1424a89-95e3-45c2-8aff-e7cea86c2bbb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255628 Nov 08 04:40:37.430826 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c8d5b13c-cb6d-46c5-a916-5c218bbd1949 req-266b0811-e54e-4683-bc92-b60e663fcdcd tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254230 Nov 08 04:40:38.526276 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e5e76d2e-fefb-4b3a-8795-176a692a82e5 req-52ea651b-f012-4354-ad33-2507aa25cf49 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0261033 Nov 08 04:40:39.620865 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e575bf2a-9e56-4b4e-a154-5754ff0b57e4 req-9b0b7bce-fb39-45fb-a93e-d03d97dce48e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0287738 Nov 08 04:40:40.711586 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea563d26-e243-459a-a479-b5e59ca6e6bd req-3706cb13-92c0-40cf-a74b-f8c14c450016 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258865 Nov 08 04:40:41.802253 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a068304f-017b-4bb5-9a7c-7a96fffe9ebb req-27c57079-8f9e-499d-b548-0a1954ba0dc9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251193 Nov 08 04:40:42.701456 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-ad1772de-4466-4078-940b-c6502b35f0e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:42.893213 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-99142060-36dc-402f-9199-241784406851 req-3e71af56-e09f-4ab2-b6b6-6cf78d41da93 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253353 Nov 08 04:40:43.982904 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fd3507fd-853c-48ce-8265-e0fbe684faa8 req-87ac46cb-bfe0-4803-a8b9-0467864b6e63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0247285 Nov 08 04:40:45.073849 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a2e20236-9405-45d7-8e80-e8f5f6e53183 req-98315a48-4487-466f-88a5-cf9201c84d91 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252700 Nov 08 04:40:45.199806 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f172648d-87ea-4219-93b7-af08c1046a1d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:46.095756 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:46.173775 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d73a1d8d-424a-488c-a537-f33f3bee0d28 req-ebf5f156-0def-485c-ac32-c3a67c2a3fea tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0284836 Nov 08 04:40:47.264463 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4f06dccb-b861-4608-af0c-b070c09251a1 req-6b27b50f-1ab0-4849-9060-f0e31a67980d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256231 Nov 08 04:40:47.743043 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:48.361250 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2beff9be-86f9-4470-856d-f96225a07532 req-8086d9a8-c06e-4417-915c-f8bc2596304d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254366 Nov 08 04:40:48.405688 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:49.452868 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7c369a17-38ea-4ee6-80ac-0c50d97a031b req-273bf6f9-636c-46ba-a66a-54f38b3fcdff tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257037 Nov 08 04:40:50.546600 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a00a5157-e298-48c6-aab5-9f2d00398d9a req-a51f6df8-7069-43df-8791-e140a002dbe2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0299833 Nov 08 04:40:51.637642 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e0c3ba32-ee7c-4239-9004-2a35ed2b5b6a req-9a36ca8f-d835-421f-9fe3-32c5f60c00ed tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0249438 Nov 08 04:40:52.732149 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-09ef2c82-afeb-4ba8-bb0d-a41d915a4b19 req-5f1dc9d0-4b64-4cf8-aca4-f57b66f5c279 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0287616 Nov 08 04:40:53.824155 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fabef556-ead1-47ab-9109-122e7720dacb req-ddf944bf-0d60-4ec7-af30-d3090475cd3b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0263305 Nov 08 04:40:54.474344 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:40:54.914846 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-307e230d-cf6c-459d-92af-a588341a48cf req-8c6987c0-277a-4de1-a522-a8c412af7fe1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0261812 Nov 08 04:40:56.004482 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8855c01a-aedc-40d0-b319-47f105062de9 req-b72de54b-90ff-44fd-bc1f-1486c5e1667f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257545 Nov 08 04:40:57.098073 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b7007b5-a42b-4f39-9590-ab5b622d65b6 req-82a98902-0cf8-4cf9-ba05-276389bdfd8f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0263488 Nov 08 04:40:57.930639 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:40:58.190461 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-997c453a-873b-4bd1-9eed-d8fd90b7c445 req-d48b9416-ca07-4b16-8381-eedc0d62b195 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256493 Nov 08 04:40:59.283732 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-45cf4cf7-8708-4891-9200-6795cb8706f7 req-b1c40d97-0356-491d-98cd-a0ed55550f01 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0279973 Nov 08 04:41:00.378474 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9141dcf4-eab3-4306-b025-050841e2c45b req-bec3b17d-312e-4c12-9bfc-3cdbc94f7329 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0275946 Nov 08 04:41:01.469843 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e4b76189-b7c3-4a32-a27a-d1c93ce1b670 req-a7a5eabe-1e73-472d-a623-dbfef7514c21 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0261116 Nov 08 04:41:02.560762 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-95d7684b-f82e-4569-a335-5e0dad75b43e req-94d56851-0983-41cd-813c-2bbb16e45232 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252461 Nov 08 04:41:03.657198 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-057ad3be-6800-4f1f-89ae-4f9e0351c791 req-e12730fb-a099-4a82-bc90-081e81d1a5f3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0277884 Nov 08 04:41:04.749628 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e7dc00d5-c8a7-4eb1-8174-780f19b790eb req-b92c714b-e0bd-4646-8aff-52589eaa9cc6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256257 Nov 08 04:41:05.842892 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fd357bee-10ca-4171-8bf8-3f5cb482195c req-7e54e7d4-710f-4a47-891e-51a4836a00a6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0292435 Nov 08 04:41:06.935312 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bcc14f43-9b3d-4dcd-b398-6a83f8bda983 req-59eb02dc-b219-4896-8240-3dd92a094a39 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257931 Nov 08 04:41:08.026703 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6de51907-3c0d-4cc0-ab9d-c948fff9fdcd req-40c0b5fc-dd46-488c-b875-46e3f25b56f7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0250819 Nov 08 04:41:09.120595 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3eef0201-fc4b-4ca8-8d58-f15db3a6a1d9 req-7fff2b96-3707-440c-b60b-898a06858728 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257018 Nov 08 04:41:10.218322 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fb8aae8e-f846-484c-9ca6-37788c7768a8 req-022a0818-8ba3-4294-bf7f-15d2415c9846 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0259173 Nov 08 04:41:11.308086 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ff43b45c-9cb4-439b-a25f-e8a5ae1bb347 req-fe7e4d01-be81-4d2f-85fe-a47758397161 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255709 Nov 08 04:41:12.401406 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-38b5091b-63c7-4884-920c-a96cd7b3820d req-1655fe24-943c-4932-9705-8d5603736129 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0289097 Nov 08 04:41:12.673599 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-56afa504-42f3-4d4c-843b-2f1e7244b1d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:13.491785 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-177246e9-22f0-43f7-b328-239be4425f00 req-322bd07e-a2c7-4f8f-903b-deb6e5d7e914 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262372 Nov 08 04:41:14.583545 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-41da7c6c-3a32-4265-9b8b-ca8bcaf6f7a2 req-a742d6f5-208a-4e1e-a6f1-3274a1c242d2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0267935 Nov 08 04:41:15.159619 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3b91b1f0-5214-42b0-8f82-d6e469f55cbb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:15.680565 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f42398b-175e-4195-b585-01838deeaac1 req-ff38e437-d12d-4315-8394-49257d26eab1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0263209 Nov 08 04:41:16.079443 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:16.772586 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-415cd951-b6d8-4c4f-9f5a-2fc1e42ba53e req-7cff6c33-e6fd-4a0f-bd02-9cf947e64845 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0261772 Nov 08 04:41:17.747817 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:17.862834 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e7bf602b-d981-4e63-9ec0-913341d63917 req-e086be24-b076-4255-9e12-7b07380f0856 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258598 Nov 08 04:41:18.422232 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:18.967132 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-202a22c3-dfdb-4cf8-b207-3fbb2e4830f6 req-7da8d164-d491-4880-a46d-909859408a0a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0389845 Nov 08 04:41:20.059060 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a2f3d0b9-868b-4ca5-bd20-bb8275fc3af1 req-98871ee0-e432-46bc-9154-54e5c1ac0e25 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252919 Nov 08 04:41:21.149452 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dcd61be5-9396-469b-b01c-cae9fccc6239 req-8ce4603b-dedd-4ecf-bea8-2142f8591077 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256979 Nov 08 04:41:22.240218 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a5136bad-3450-4243-8695-61db8a091128 req-bc8dd67b-e0fa-48f7-b902-ffa1c956e3e8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0248251 Nov 08 04:41:23.329342 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-71268bd2-5ea9-421b-ae57-f2ff33195be9 req-f224c182-25d7-4997-8e11-dc2a7545069e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0248623 Nov 08 04:41:24.420392 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2e26cc10-be88-48d8-8721-0c788e2d0e2c req-d3ac76ed-fdd5-421b-b4bb-c07ef19c531d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257130 Nov 08 04:41:24.516843 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:25.513606 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e4885292-cfe2-4208-b58d-e5f1aae32348 req-93699006-a64b-452a-8b73-5fba84363595 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0291777 Nov 08 04:41:26.603527 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-09f9a1f4-01ec-4ce0-bfb2-85ff29116697 req-90f47b19-4045-4f07-b27a-a7751d2f2ed3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257800 Nov 08 04:41:27.693587 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a2ffb280-09b1-4e98-a643-83ac336c79a6 req-60b70b15-3904-4280-b84e-687447482af2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251462 Nov 08 04:41:28.785206 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-70401e0f-3f42-40bc-b5bc-5cd877b5e8a1 req-5c1d570a-b303-456e-b9e9-5a0be9dde8ca tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256751 Nov 08 04:41:29.876035 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d6f6442e-ce35-4c31-9988-786550880e25 req-e4a3103f-775b-4430-8c3a-a399f9bf7a3f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0250056 Nov 08 04:41:30.967354 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea1983c0-259f-4166-adc1-630c06244fa2 req-46739a66-6325-4bb2-bb93-e84af0183770 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256271 Nov 08 04:41:32.059982 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8761a20e-9a7e-4e2a-8bac-d819023d060c req-3a069bee-b6b4-4612-bc1d-a8edaa796dbe tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0288024 Nov 08 04:41:33.150530 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb2088e1-e93d-4d44-b8fe-32b4101c5f1e req-015cf032-076f-4503-8374-cebfa017e0e3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256798 Nov 08 04:41:34.255743 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fa9d46d9-cba8-4882-8c22-5a790321af64 req-06eb5a56-c0b5-4d12-a3e7-b61ab3205d2d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0294838 Nov 08 04:41:34.929376 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:41:35.347621 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-adc54279-e631-4a4a-9ae7-9b0d8666d41b req-0ff3d86a-fce5-44fe-9471-c16e95bc65c9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0264394 Nov 08 04:41:36.437645 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1d07e9a8-9701-48fb-9a25-d77bfc1ed01f req-e8ebb9f2-8834-471e-9645-9e0780d95bab tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256238 Nov 08 04:41:37.527471 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4747de72-b856-488d-a2e4-04a0f591fe06 req-ada97d51-a6d4-466b-baab-3f6c0013bcb0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253673 Nov 08 04:41:38.620246 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f97c0057-e6df-46ef-bb4f-5232df8b0207 req-583f702f-0ffd-47bc-a1c3-b3a72eaf0854 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0282018 Nov 08 04:41:39.711843 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-175bdf9c-638e-4c6d-af6b-367d036542e8 req-d0fe970e-ec00-45af-a753-3496f5a4d1df tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258710 Nov 08 04:41:40.803605 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-54fd46f5-ccaa-4e5f-ad97-11471aa61262 req-aba2fcfa-271f-43c2-9992-d2578b4faeba tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0259981 Nov 08 04:41:41.893673 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b9e99736-0d3c-40e7-9c69-a13abb36d5a3 req-c74342f1-c65a-4151-a39d-9d1b365b8b27 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0259233 Nov 08 04:41:42.672856 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b9ccbf60-2d6a-4860-bdb2-96f441711f2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:42.990408 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-13cfdc95-8fba-4176-b9b4-d4d513bc3888 req-c7511e0f-c15a-4450-991b-f03cdeaac7fa tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0321965 Nov 08 04:41:44.080036 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4555d7c7-1b57-4ce6-9e40-b3f59993c569 req-ca7b4026-e9eb-424b-960e-cdfe7a93ca59 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255220 Nov 08 04:41:45.164388 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bf2774a9-9b79-4a49-9a99-c9c9f2cf66d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:45.173372 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-353e6161-4f07-48bc-b6cc-7531241f45e6 req-1385bf05-9863-4738-9eef-2b4e8dccbf9a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0285604 Nov 08 04:41:46.095969 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:46.266910 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8686aa09-8c6f-46bc-89aa-0f54e5b7b2f9 req-0f815c95-2952-4433-bfde-08c1306456b6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0250254 Nov 08 04:41:47.357683 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cf5fe842-31fd-45eb-9a7c-fa862f408844 req-a546d133-48d1-4259-ab0a-96a66f78bf9b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0248380 Nov 08 04:41:47.796150 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:48.444551 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:48.450770 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-867260b4-903c-4bea-8ee1-42c68552155e req-5e437a7e-826c-4746-9ebb-319d6f6ae835 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0275581 Nov 08 04:41:49.545130 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-23f8f8a6-b1e3-4f62-9ea6-b8d298ece69c req-5ead113e-ff26-4d9d-9161-6172c221ccdf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256903 Nov 08 04:41:50.637000 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-39fa88d1-7559-41c9-bab2-9a211bf55fdd req-43012763-a8e5-4040-a0b5-622207140f61 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251122 Nov 08 04:41:51.730056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8152eddf-4d7a-42f4-8308-88141783ef6a req-5998b60e-cfae-4ab3-96cd-0112026ac718 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0278347 Nov 08 04:41:52.821837 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b19f9a79-d6ca-4b72-8102-c576fa826a12 req-eae9ea1e-bbe9-4a94-9806-e73ab1c8ada7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0259306 Nov 08 04:41:53.913336 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f7d7876d-e687-41b9-95f9-93f5ad902db2 req-edd0bacc-1285-4aba-ba59-9035142e7a43 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262392 Nov 08 04:41:54.495054 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:41:55.003219 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f3904e27-a695-4a1e-9ac3-9eee49f35400 req-587d4baa-53cd-40b3-ad04-dce255f26dda tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254226 Nov 08 04:41:56.093739 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e923c407-2411-4f61-9069-0aa0905da804 req-bf9672c4-f5fe-42e2-86c6-3bc6ad78091c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258155 Nov 08 04:41:57.184654 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-be5cc38f-f702-45d8-ad24-6fb9249c6758 req-04903589-4b87-47c2-9dca-12c9a88cd136 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0246582 Nov 08 04:41:58.282770 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-863de664-4a1c-48b1-af32-2202b9da3ea3 req-363255cb-f0f4-44e7-9e65-5b78ef1afaf0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0274665 Nov 08 04:41:59.374469 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1da9a7b8-f9e7-4f51-99eb-1579f2d5870d req-a3cc8e53-0fd2-4fc6-b823-a96f403ac4b1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254211 Nov 08 04:42:00.469179 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1dcd2fae-fb2f-44ca-a4d0-2353861220de req-02676c78-006d-4b71-acf5-650d9ea3f7e8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0306592 Nov 08 04:42:01.560467 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0743ab48-bd79-45da-aaa0-f672e67375bd req-9c962e0c-ad6b-4ff6-b1b9-52349bf7e1a7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252306 Nov 08 04:42:02.651468 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-07ecf259-022b-490a-bc60-cd42c658fb72 req-abb3576f-aa82-4b3a-aefe-81bb72af175f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258322 Nov 08 04:42:03.788787 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4ec88b33-f5fb-419f-bfde-13d3b363917c req-e6130fc8-d687-4e93-83ed-c16f576669f9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0261099 Nov 08 04:42:04.887586 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5f7b6734-9c2c-49fc-93b5-366565e5a724 req-8f6a7a26-cb2c-4b30-b8bc-c5f36166fe83 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0284119 Nov 08 04:42:05.978858 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25135c9f-e659-40c9-b0c7-1affa1820583 req-8feb5354-3cab-4bfb-b5be-123709e13edf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0266600 Nov 08 04:42:07.070122 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e180358c-1fb4-499b-b086-c0a785620752 req-88158710-0164-4f6d-9ef2-afe2d11a7c0e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257199 Nov 08 04:42:08.161706 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7234eb83-6032-4300-8bc1-bd7dce15aefe req-264c17c0-3bf0-438b-9111-f171dd488761 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262783 Nov 08 04:42:09.251520 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-87a5e083-0998-43c5-8018-265550ab2a71 req-5c7acdeb-70be-4c10-85f6-fca635c6bf85 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254698 Nov 08 04:42:10.340193 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98b2d49c-89eb-44ba-852b-5d11551941cc req-84eb1b21-6458-4e5a-ac45-7a4f842dd86f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255854 Nov 08 04:42:11.439319 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7341432a-6819-481e-bbb0-e38aaf18eeef req-27724195-9290-4fc4-9ca4-260fb2790889 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0292628 Nov 08 04:42:11.928216 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:42:12.534166 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9936a51d-f9a7-4eec-805d-cccb7d27593e req-b7fd3071-9a3b-4999-84f6-4d327fadf596 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260217 Nov 08 04:42:12.669924 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-2dbafee1-c7df-4ebd-b831-43030c39a465 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:13.624971 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-36dad54e-69e4-470c-9c37-91d4b3a96207 req-bf754c3a-e861-4885-8067-ee7e9adc03a2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256491 Nov 08 04:42:14.714647 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a445509f-0e31-4219-afc3-616697ac886e req-efcb20f6-1757-447b-bc8f-92462244aaea tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0270960 Nov 08 04:42:15.169191 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b2905877-65f3-4bd0-9e40-5a7dfd1dd7c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:15.804329 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1086a870-3c8a-4252-a03b-4d622d6c84fc req-092df8fd-ebee-492d-bd6e-3609c6897a43 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256641 Nov 08 04:42:16.098323 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:16.894106 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d03c23b0-bda6-4300-98c9-a92ac03847f3 req-31c4c32d-28d5-462a-a231-f671419357ed tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0246058 Nov 08 04:42:17.740468 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:17.990940 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-baf3c64e-5414-4e71-a7fa-7fd5910b2863 req-50ea64c5-4047-4da2-9750-371be989c983 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0282280 Nov 08 04:42:18.413051 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:19.080732 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-277d301e-7c74-420d-9d3d-0bff6f30117e req-151c4f23-56c5-468a-bb59-96a3f36b4eb6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251639 Nov 08 04:42:20.170597 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-32fb028f-b2c0-4786-bd8f-543c83522ebb req-7672defe-d9d6-454d-b6e9-2b004aeff63c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255616 Nov 08 04:42:21.261903 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6723c366-5473-446e-9b09-17a0eb3bd8ac req-39a6a1e8-2742-4a41-a2b4-b4e5b61b2a03 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257566 Nov 08 04:42:22.352698 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a54a1c4e-dd03-488d-ac3d-d7b237dd43f6 req-7f21d1c4-df4e-45df-9b42-0af594d9fb14 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262153 Nov 08 04:42:23.443048 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4ce88238-1139-4c3b-ad11-01d83ac8518f req-6186242c-6335-4fca-ac42-27fe94423629 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0259624 Nov 08 04:42:24.497861 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:24.539832 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-dbbf1918-a0ed-4ebe-98fe-a626b38b5516 req-5dbfd2e8-ddd0-4eb0-9b8d-1d2e2d72a2e0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0289366 Nov 08 04:42:25.632319 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eabb0ef8-4ee7-41db-8fbe-9f189192afbe req-22bf6ed8-ef51-40a7-8bbb-3b7fda688c8e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257328 Nov 08 04:42:26.725364 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8d2c0a68-5648-4e1d-a348-f6f9d44637f3 req-63e99bf0-5a60-43b0-a17c-4bdf7030dac9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260766 Nov 08 04:42:27.817449 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d4b93ee7-7a87-4192-bff1-c4ebb069d640 req-bbc5ece6-2cc8-418c-ad4a-59fbb452653f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0274973 Nov 08 04:42:28.908438 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6a1e05ae-d33a-4010-9ed6-927612eba3d8 req-f057cec6-b499-4bd0-a239-2cbb1d8df2ce tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252032 Nov 08 04:42:30.006525 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bfbcc28f-b32f-4abe-b1f4-5c217fd19b2d req-3fe3ecae-7322-46c1-96c8-2c3e416a0bf0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258560 Nov 08 04:42:31.099535 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-682b44d1-0fda-48fe-8bf1-490199ba423f req-4b822a69-9500-415a-bbd9-fdc2120b97f9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0285623 Nov 08 04:42:32.191056 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-76e567f3-7b39-4c6d-9865-1f204feebd31 req-9a70a851-c7d9-4b59-8daf-9ff3e1e7ed3c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0267200 Nov 08 04:42:33.281306 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4993779e-3565-4ada-9284-ec1eaf832ac7 req-1b2de55f-ee5a-48ff-882b-3e6491b51a63 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255096 Nov 08 04:42:34.374130 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b0290fea-ef4c-43bb-a802-007f0030375e req-49f93b43-5df3-4bbd-a6f6-6add669ceeaf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257847 Nov 08 04:42:35.464898 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-91d06a1d-b6f5-47a0-8abc-85459b117c26 req-e1f1be7b-ef98-4978-88ba-a50e88c5b9d9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262165 Nov 08 04:42:36.555695 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-642682c3-fa6f-4fb3-9bbc-77bade518902 req-8df84da1-b724-4413-8ec1-4bfdd8701cdb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262618 Nov 08 04:42:37.648617 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f9cb44f5-81d9-42f5-9b0e-26703a6ef6db req-dd50630f-abfa-4a97-9b6f-6ac46979b88d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0278633 Nov 08 04:42:38.740963 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-172a6f63-7365-4868-bbd2-9150c559a3d7 req-eac7e978-40b0-425d-962a-c13a65d650a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0264785 Nov 08 04:42:39.831728 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1ff962e-1d6c-4d08-8771-90bf8d3f02be req-f4c4c182-c9ed-442b-9629-8fe73b1b7b31 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256135 Nov 08 04:42:40.922533 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b6566b94-d6ea-4044-8c6c-bf414d5ccf1b req-46e617eb-53c2-4571-82a0-6843418ebdb7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255148 Nov 08 04:42:42.012434 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fbf96adf-8f09-4f34-91ac-336d440d7954 req-15001369-454a-4a16-9c09-eea82044b038 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0250459 Nov 08 04:42:42.676866 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-6c2d53d1-cfdc-4f1b-8f31-4af2e18e3dbe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:43.104544 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4ebde8fd-e027-4270-b8a9-7b1c52feb2ef req-e2e2827d-7c24-402a-b6e4-774be2ec4491 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0269041 Nov 08 04:42:44.201033 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7dcefae7-59e4-4940-b7f6-e1232e4466cb req-72fcfcb4-772d-4d50-bea7-5e413380a2db tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0286453 Nov 08 04:42:45.159916 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-4a11aaf1-c21c-4332-9c0f-63240917eac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:45.291975 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e289f76f-977b-4998-8adf-dfdaae6c75a1 req-78aeafdc-b204-4981-89d4-cdbd6ad499d8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0247934 Nov 08 04:42:46.103127 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:46.383663 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c8a7ae7b-3839-4f18-b78d-69801e8f12ad req-7c598148-aa7d-49a2-97a0-15e40f51abbe tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256605 Nov 08 04:42:47.474972 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-acc427dd-0c0c-4650-9162-03bdd585280b req-a3c00803-2477-4019-8977-c771f1202374 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0261202 Nov 08 04:42:47.811411 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:48.391190 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:48.567875 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-343097ab-1939-4778-b74e-ba3b183fc3c9 req-b0a5ba7e-8850-426a-baf0-bece6ddafa96 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258236 Nov 08 04:42:48.927256 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:42:49.663281 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8888ba19-11e2-4d5a-bcd0-b818e7ee2fa7 req-976a557a-8536-45b7-80b9-fea6690f6328 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256701 Nov 08 04:42:50.758697 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5bf65928-edcc-4466-973c-e98ad9fd60ae req-ba5e6845-5dfd-4883-b2c3-6c4233c74928 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0289793 Nov 08 04:42:51.849713 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f522c712-79c8-43ee-993f-e9f14524b864 req-a8859b1d-1026-4e8e-9cf2-065e067cee6f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260999 Nov 08 04:42:52.937920 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d5ab3842-a9eb-457c-a3ea-a0fca87c86fa req-572945a7-50c2-49cc-96cb-ca110f4c329f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256171 Nov 08 04:42:54.028994 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0c693ff1-fa72-455b-99df-bd2465333d01 req-420dbdc5-1c5f-4b76-95fb-1796b50877c1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258739 Nov 08 04:42:54.534026 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:42:55.119341 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6e54ea5c-7ab9-4af8-9411-559ccf456039 req-8c644049-9c92-49e5-b6ab-d55ce81a12ce tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256054 Nov 08 04:42:56.211865 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-75a4cc46-266f-4a0a-b6e0-689f8e8b6085 req-5040ab7f-821e-4a08-9e4f-cc5c09374a52 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0265141 Nov 08 04:42:57.307521 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-83e4f992-dd9e-461a-ab88-4a5655a7c4b9 req-1485252e-9f9f-4d23-b2cd-3325cf186dbb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0281298 Nov 08 04:42:58.398930 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-88faeebc-4d82-400f-a424-abf85de4132c req-92515895-8944-44ef-b474-2001fd57f1b5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251231 Nov 08 04:42:59.489259 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58ed3901-d8de-4d7b-a7cb-595c0a906116 req-a07e6d48-ef6e-4aac-8066-7df299fea565 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256529 Nov 08 04:43:00.579664 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8527cae2-dc4c-4758-ad95-4a9b8675f532 req-2c5a4f69-81b1-419f-9874-947767f44482 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253646 Nov 08 04:43:01.673162 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34bf8028-370d-430e-9886-c5a8f0b956e6 req-5ebcb335-f59e-43c0-923a-42de92350193 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0266767 Nov 08 04:43:02.764424 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-28838ece-c68f-4f33-aa3d-aacd076a8f69 req-4a5d2081-722f-442a-896f-427a1ea65ec3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252023 Nov 08 04:43:03.859455 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2075121d-01a4-4d87-a2d2-795dd0f26760 req-df278a07-9c56-4568-8091-cee7568e8915 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0283306 Nov 08 04:43:04.949511 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb864575-ef5b-4760-bf4b-1335ac5b91a9 req-76d1902c-b033-4491-99e3-210795bfd63b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258842 Nov 08 04:43:06.041272 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25bd3568-4600-46d8-92e1-641b126ab293 req-c3dd3109-58e6-44eb-b7f0-6b02bdfebc93 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258312 Nov 08 04:43:07.138048 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-14e23c28-d677-403d-8ee9-42f792539fc6 req-b66d979b-c009-42ae-8a5d-a2dc60fdbae0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257668 Nov 08 04:43:08.392430 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-903bcd90-0933-46e6-9147-3b3e867c321b req-53776827-588b-470b-beab-895304a5630f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254645 Nov 08 04:43:09.483083 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9b42e17c-54b3-41e1-af91-c4b56f9dcc76 req-bdbfd6d8-ce99-4008-b8b5-836bc40b4af3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0248899 Nov 08 04:43:10.576832 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bda37d43-f095-4df3-ae49-7bc5fb1937a1 req-331d52ed-e61d-40c9-b992-a9a40e7401f9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0292549 Nov 08 04:43:11.669072 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a5ee7dc1-0b7d-49b5-9a72-8b11e29b65c8 req-32572b1d-1f4d-469d-ba24-4c63afcf0c75 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255184 Nov 08 04:43:12.662766 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-810c625c-64ab-450b-984c-5937c626fda1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:12.760267 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-abff0343-86c0-4759-b5ce-680aee0db80c req-833a0d87-d9a8-4955-82f2-e8837bfc4887 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257192 Nov 08 04:43:13.858978 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8c60587f-6dfd-4ade-9f25-fe92e9d93c5a req-ed5cbc08-f6b4-4f81-a697-8c2107e3fa6b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0276055 Nov 08 04:43:14.951383 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2c45e8ce-f73f-4b2c-8b3e-d21dca7b0129 req-aa7926ad-758a-4041-92b7-3a878a8d3d8b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258887 Nov 08 04:43:15.161878 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7d749255-5e6c-448c-bc27-a578fc10b50a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:16.043288 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0801355e-3d44-4f15-ba0a-9c40022a0234 req-611fae34-2b5d-492f-bc28-56b75d8d6199 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0259960 Nov 08 04:43:16.111342 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:17.143730 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a12ba62e-b927-4f9f-8c43-c5c631ade049 req-38fbf572-30a4-4b19-8c81-0412f8696fb8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0346177 Nov 08 04:43:17.762056 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:18.233907 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00135c38-1da5-4157-9ceb-3a85e0f08786 req-609a74a5-6863-4437-846d-388ea576bb90 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0250583 Nov 08 04:43:18.385022 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:19.325431 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-87068571-0e99-45d9-92ef-d62f1d6e13e3 req-0871086c-1569-4bf7-9efb-6970d060cd3c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253594 Nov 08 04:43:20.415574 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3193d2f9-f758-492e-a119-abd4b301ea6d req-3ad58343-513e-45a5-a2dc-13b2efeb81b7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262043 Nov 08 04:43:21.507528 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-67ecaf99-eeff-43fd-8668-bfb7ee2a6c62 req-b2342fdb-3ca1-40c4-8e07-5bc7b8cf5619 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0270486 Nov 08 04:43:22.601079 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-92ace8e7-4e9b-4a79-85ab-840a930ec9e4 req-eb21a57c-8275-4586-a26c-c66445eb6b85 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0248942 Nov 08 04:43:23.694432 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d1bb9fac-7851-4a09-8266-abfea747473e req-af726bb9-e68a-43ff-8819-438f0e9828d0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0280740 Nov 08 04:43:24.510046 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:24.784636 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6c2834dd-014d-46f8-bbb4-ead67b24e278 req-71b45847-a560-4496-998a-e30be67c1661 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254486 Nov 08 04:43:25.876404 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2aea6203-df37-4889-b80f-c3b52d16c46b req-79813862-5ccf-4f6a-8794-42321274158e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253046 Nov 08 04:43:25.925940 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:43:26.969223 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ad73653-de20-4064-a496-902b1a8de573 req-54482a26-03dc-41b9-8fe1-65b366e8280a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260293 Nov 08 04:43:28.058454 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f0ed0854-e700-4abb-8fff-e59794713df8 req-3db18158-cfe6-4e41-9fe3-bbd26036719f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253062 Nov 08 04:43:29.149066 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3b9bafe9-c340-4405-893b-04456859f6de req-fc143e32-8033-4fd6-afa2-694c0a0bfde9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0245349 Nov 08 04:43:30.246879 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c857b64e-177c-4e0f-bcd2-eb5a79116cf6 req-fc2f7ba9-4f9d-422b-8f82-5769b40689e7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0281563 Nov 08 04:43:31.602790 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f252350-cc92-4130-95c6-02b30f24d543 req-9467693b-290c-4520-9214-72e3d3fa7dbd tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.2916267 Nov 08 04:43:32.693566 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6d946d53-f9cb-45d9-b23e-5f583504b141 req-d9713f2f-fd77-423b-923a-2b166bdd8dfc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252657 Nov 08 04:43:33.784211 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ac8a2b9e-06fb-495e-9220-5726501fda13 req-df9842cb-a963-4ace-ade3-40b1095d5aa4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0248706 Nov 08 04:43:34.874587 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-021a7a0c-50c1-4efd-bd49-043bd0b52330 req-514ba877-f662-48ac-bc5e-aa5d43a6a03d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0247440 Nov 08 04:43:35.968533 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-73dff251-c913-420e-aa38-da6b08970230 req-9c566a3e-29fb-4a0e-b5a9-706e70cb60d3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0276525 Nov 08 04:43:37.058553 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-67a47a40-412b-43b8-9828-a4b5c0a8a532 req-d628c5d5-38be-468a-8db0-f7562b7a7db9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0249271 Nov 08 04:43:38.148540 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-12f99f02-77b9-43a0-afdc-a4925c581193 req-da862ea2-f27b-4943-bd19-fd7d0f41526f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0247900 Nov 08 04:43:39.241152 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cef89349-f55b-4449-a365-840efc3fc386 req-7c24dc86-c186-43ca-bc9d-cc83f703146d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253634 Nov 08 04:43:40.330402 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2c21942b-c0ec-4fad-9021-89e8737c67b4 req-77f7e1f1-8a9d-4a7d-857c-f27e8e92ff3b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0248530 Nov 08 04:43:41.421759 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9c24d699-2fc3-4a4b-bf81-14bedecff1ca req-5abe6559-904c-4a9f-8d7e-65d3f8e9b620 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252359 Nov 08 04:43:42.513923 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c5b5513a-c384-46c0-b492-714e6132748a req-54823338-7361-4a9c-aab7-ce8602eafd25 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0271373 Nov 08 04:43:42.672466 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8866a413-2973-440c-b087-8f01d512d83d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:43.605136 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2c4d6237-6516-457b-8eb8-f3b5e9ec85e9 req-ed257c18-1ded-415c-a959-56318b2ff8df tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254495 Nov 08 04:43:44.701241 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-48181f22-7aaa-4a4f-a979-1bfe5fb3e1f3 req-d28bf3ae-68e0-4c25-80e8-48b8db7a2b81 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257504 Nov 08 04:43:45.160894 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-6166ed07-e19f-4f47-8599-b73dcbfbfe2a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:45.792972 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f079babb-dbc2-4d27-91f2-b5818c065a83 req-cdc0aa42-728a-4846-bd44-40e8e5acdae5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254202 Nov 08 04:43:46.095848 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:46.882917 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-15afe44c-c539-4edd-8b8f-c1b22bd5510d req-92986c12-23bb-4bce-a4af-0d643aa46ba6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260737 Nov 08 04:43:47.783975 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:47.972439 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9e65ddac-20a6-47ec-ae1a-6874a3d1b4ad req-18276cd5-14a2-4b12-b40c-deef112c1ed6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251982 Nov 08 04:43:48.417975 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:49.065166 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ced92081-9a5b-4a57-9c2c-e588aa42e2a4 req-82103841-f78b-4005-b5f0-1f9a4a015d3e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0285358 Nov 08 04:43:50.155132 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-93b001b5-3bc5-42a0-aad3-5a80687fa60f req-bfd267ca-aec2-41be-b1b5-f452bc669404 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0249496 Nov 08 04:43:51.253519 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5ad31ba1-8031-441a-971b-99173680de54 req-2e931286-31ec-4efd-b4c3-360bbb193458 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0271003 Nov 08 04:43:52.342875 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9ab02b7a-9e2d-4bee-8d26-9d8152f1cdbe req-bdf080ad-bb00-4ec6-a72c-8fb4d79eae4b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254006 Nov 08 04:43:53.432143 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-408ccda1-9258-4b72-b9b2-f0a93ec37f16 req-6e09817d-7d5e-43f4-9d1b-05b4e40f6fc4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254371 Nov 08 04:43:54.509427 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:43:54.521635 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1141aad6-d516-42e3-96b5-75c78b82cf9b req-fae07118-a566-4e2a-bd82-a267e356b36c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251567 Nov 08 04:43:55.620020 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3470b0ab-de2b-4fe5-b011-01e79ebd8014 req-403cd2dc-15a1-4116-bcab-dcf085c97afa tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0285256 Nov 08 04:43:56.709532 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b1e4c0d7-426a-47a3-9e36-aa121f6d0bdd req-651f7f37-7aa9-48ec-9e58-f488ac27de36 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251560 Nov 08 04:43:57.799922 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5fffd983-1767-41f8-9a07-38d943ccc6d9 req-7d208548-86e0-4281-830a-f8a288767393 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255175 Nov 08 04:43:58.892283 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e456e1a6-46b9-43c3-a720-5ce8a65685a4 req-fe75b2b3-0090-4d45-8b0c-3d1ce3d3a2ae tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0268576 Nov 08 04:43:59.986764 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98a0f33d-6e91-415b-af5f-11cb76363d32 req-785e3dc4-c879-4951-8aff-8aac79f41eb6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254247 Nov 08 04:44:01.076468 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-98632e95-e279-455a-b384-3242c82c58dc req-1a4ec4f0-5cbd-4e92-9d34-35dbe8a952fb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254838 Nov 08 04:44:02.169634 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-449819b8-9b39-4037-beae-26802e3d7a4c req-7f0d45f2-f6fe-405c-8309-14792f578ca2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0279307 Nov 08 04:44:02.924003 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:44:03.261724 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8df3cfc3-6d27-4c8f-b062-f237002cd6c1 req-7891552f-d703-402c-b3f3-f012a9de7997 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257299 Nov 08 04:44:04.356223 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-162af987-619a-4d93-a2e9-d8214e85ae00 req-df665a38-e235-49cd-8c4f-f206f2c9c278 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0249112 Nov 08 04:44:05.448958 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-25e0233e-fade-44f3-97d4-4a42bcc1f77a req-aa83d1ef-293f-4ebb-8929-6b716276eed4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0272918 Nov 08 04:44:06.539492 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b43b2f8c-e4f0-40b5-998b-766884e6cd04 req-a6f78ba3-c8fa-46a0-8de1-12288e8acc0f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252323 Nov 08 04:44:07.630877 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-36cf1050-ecee-4254-9fc9-70b613fecea6 req-60794adf-3be0-4a87-9cde-1c3b92a96cf0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251563 Nov 08 04:44:08.723500 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3523407b-8cb5-4952-8c1d-0d6036f61f8a req-3adaaccf-5cd7-40f3-bcd8-dddee2905445 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0281317 Nov 08 04:44:09.812151 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0f4ae3b4-c733-4dea-a6d6-5868b50b1ecf req-3cbeaf4d-4948-44a8-82e7-8246d20b42b3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0247507 Nov 08 04:44:10.903093 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f7d2fda3-da85-44e8-aab0-8e631c9d183d req-d2ed9d8f-75c5-4d99-8068-a7d05170a5be tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0246413 Nov 08 04:44:11.993851 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c34f1ac4-3aea-48a8-8910-68b02f811841 req-2bdcc857-37d4-449b-a507-ed32d653f8fe tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258291 Nov 08 04:44:12.660199 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f7f717ac-7a40-4b0e-a37a-2bb39b066304 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:13.082963 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-226b3eb1-aebc-427e-abe8-890dc4a67fd3 req-2767a083-9b2b-477d-8b5f-5847cb26dcf5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255277 Nov 08 04:44:14.176413 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b3f6b7b6-3ac4-4067-a38b-926f01b25f19 req-51447cf9-bd29-4efe-95f7-ff691aaf25ff tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0281484 Nov 08 04:44:15.183373 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-202b49d3-0eca-4a20-ab8e-4a3ddcbdd2f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:15.274303 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-931a8828-902a-492a-b2a2-98eef14f318a req-8d81017b-8b1f-4ad8-a4d3-3e0109df401c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0306451 Nov 08 04:44:16.106021 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:16.366710 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-53392d7c-b93f-4d4f-81f6-6459727bb76c req-d5b75028-940f-468e-8dd4-e08b2f0050f9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260668 Nov 08 04:44:17.458216 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3cf72f53-7181-4286-a0ab-f2e588244898 req-35014fee-49ea-4d62-a5da-a88896c16e96 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0271428 Nov 08 04:44:17.754357 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:18.420103 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:18.549575 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f93ddf43-e8fb-4b85-95f6-a497a14cc249 req-48175102-3efb-48a1-ae5b-2c1c9150ff66 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0263212 Nov 08 04:44:19.640149 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-eeda95b5-3323-4425-a2bd-8d1d5a536a3c req-0662be06-c516-44b5-8f5a-1b480c800a83 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0248959 Nov 08 04:44:20.731090 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4d9bfbfb-a6c2-485f-bf08-76179aaa56f0 req-b536325c-ca29-4df6-be3a-26b573bbe2d7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252573 Nov 08 04:44:21.928132 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-01b4cac5-967b-43d8-9621-e8c293cf19d2 req-16af1d6a-f010-4005-af7c-adafc658653b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.1256006 Nov 08 04:44:23.066663 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8530edec-62d7-4da5-bbd5-d353bbdb37b7 req-842c709d-abc9-4c42-ba10-de90e21c43bf tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0733840 Nov 08 04:44:24.157304 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58142417-f7ef-464a-aaa5-87c45d803480 req-a0764300-0d7e-419a-b238-2df77fba5704 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260701 Nov 08 04:44:24.551319 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:25.247323 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f54eaa4c-cefd-44da-b81e-bfef55dcae84 req-71fe2e0d-8761-44a6-ab81-1ce896a8c97a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255811 Nov 08 04:44:26.338110 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-07b56a5e-7386-4061-ba6b-1382b5988185 req-a2f7b095-b2d0-47e9-a60f-1b0e9b4ee4e9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0267017 Nov 08 04:44:27.431673 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-012e4c3d-8f71-4aff-83a7-176cbe9ed2a5 req-0e3d6e80-4943-49da-a51c-d6e309a5a72f tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252149 Nov 08 04:44:28.525631 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6d481614-8b84-46ea-bb56-b260d55e4c70 req-d59ca5de-adb3-4b53-b0f5-9b4778638001 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0287061 Nov 08 04:44:29.617005 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4db1c290-a908-4ac1-8891-52459e985d3f req-d79092a1-42f9-4342-a1cd-a4ddb2c229ef tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255136 Nov 08 04:44:30.708689 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c95bbc01-63ce-41ac-96ee-455dd9ab272c req-f36b6b4f-8b6d-445a-9064-ef4cd3dcac04 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262690 Nov 08 04:44:31.798415 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6ee8e7e2-b288-4e8f-a46e-06e6b86112d2 req-ee6ea98f-bf48-4cf8-b9e9-9e1ef1a6eff0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257187 Nov 08 04:44:32.893971 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cabef70c-6d1f-4495-becd-2ac353f7f928 req-fc9c68d7-6aae-4335-ab17-43558b3afe16 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0247028 Nov 08 04:44:33.983375 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b14747d1-7e08-44b8-b927-9bb605439ef1 req-a0c1dbee-a995-4113-a6c0-5e336704404e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255945 Nov 08 04:44:35.076575 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-285a176d-4fe3-4812-959b-fd87c76d078c req-5fee78f0-ce5e-4982-bc95-8c849a576c11 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0287039 Nov 08 04:44:36.167440 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b171491-ba9b-4682-8049-339f426c431d req-179f084d-0b6e-436a-811f-8755a56d5ff1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256121 Nov 08 04:44:37.260002 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b5a5913-27f6-4802-9a29-57032636e6f3 req-548b3df4-6218-439e-8d18-4c11ea2b146e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258975 Nov 08 04:44:38.353209 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a6ff34d6-2ced-4f77-bf66-c5eea4e7a890 req-2952dcfb-1ba9-428a-804c-7debfea49c37 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0273125 Nov 08 04:44:39.446862 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c481cfee-06a0-4358-8114-122920be837f req-b1712da1-48b5-4b40-9eda-6aae95d62c22 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0278909 Nov 08 04:44:39.922191 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:44:40.536493 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-b559d71d-6541-4920-b620-dddc05ba01f5 req-ede9e72f-d9c2-459f-8ab6-3a4a94eee458 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0248618 Nov 08 04:44:41.633659 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-9eb843bb-5e28-4325-85e6-e2e6c684acab req-3fdc54c6-02b0-425a-8033-ade3477bb83d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0288301 Nov 08 04:44:42.687965 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-361a884c-2e0c-4298-9a99-f55aa18e96a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:42.727448 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d69daab1-6793-4079-b76d-d6ad00463d29 req-07dfba6f-4ebc-489b-8f4a-055922dfdaf0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258586 Nov 08 04:44:43.819475 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3ba4c255-9f82-4c28-964f-f9f0fb0a55a8 req-c9684eb7-e903-41d4-be89-b6dbb50d0bde tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262985 Nov 08 04:44:44.911319 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-04475ba4-b09d-4014-82fd-b81ff33a89e2 req-022d05c3-b853-4ae3-9f12-29face8da2f6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257428 Nov 08 04:44:45.190897 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-6154e421-3fc1-4190-abf7-eaab35350797 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:46.006329 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e69152d1-d73f-4bdf-91fc-c899f51d19a4 req-b0185fc1-a5da-4427-a6f3-97c03ca6fea2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0270796 Nov 08 04:44:46.116324 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:47.099956 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f3b85532-766f-417c-a992-60fd85617d15 req-2d1993b5-21ad-4d84-acf1-6c9e84ba3db9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254860 Nov 08 04:44:47.765300 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:48.198992 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cb956ac5-59a3-4da7-9253-58ed982afd74 req-ec5c6cd5-636a-41fd-bb57-0556e30c0af0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0319815 Nov 08 04:44:48.413535 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:49.289012 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-df6f3b56-72f6-4409-a0fb-9e802fe5737c req-2753e4e4-9806-4305-8406-9228a7022d55 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254304 Nov 08 04:44:50.382813 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-58a598da-b864-4685-9553-146c502ac920 req-50662b4f-7321-4cf4-a74c-ae4ea1ca2151 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0266166 Nov 08 04:44:51.474154 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-518c1f63-19f5-48ab-af43-fa16fc1de23c req-b77f2c7b-db86-426a-8dce-b97fc840cee2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262439 Nov 08 04:44:52.565893 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c067dda0-784f-4742-9f0c-cabd02043dbd req-f0ace553-929e-4341-810f-eb42826f4711 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262957 Nov 08 04:44:53.657594 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d592b4ad-dc15-4c68-92ef-6365011816ed req-f42cac6b-e002-4f24-afad-d92e58dfd0fc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0265188 Nov 08 04:44:54.553324 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:44:54.752061 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-01860e29-fd9f-4f7b-80ed-71aba99b3bd2 req-32f095bf-998b-4b06-be7c-c9882a94c01e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0295291 Nov 08 04:44:55.841916 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e78a5637-923b-4a93-901f-d33ab4f51629 req-2cc8533c-064f-4e1c-b2f5-0fad63bbab2e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255740 Nov 08 04:44:56.932614 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0ab7103f-aca1-4a17-b9ba-ef3b5624d224 req-2ff1bbab-1138-46c0-a138-de3557918b84 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254662 Nov 08 04:44:58.024252 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6b500ea4-d5cd-41bb-98da-0a38de6b795c req-69600516-402c-46c7-a424-8e3ee9c30b9b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0250270 Nov 08 04:44:59.114997 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-244dc8a4-8ce6-4fba-b69d-b42ea7c21439 req-19a79a14-b0fb-4679-9727-b78541032528 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262539 Nov 08 04:45:00.219372 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1bc6bc1f-43ba-436c-94f3-909ef155cd7b req-0b07073b-901f-4001-bca7-a77275fc0316 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0264359 Nov 08 04:45:01.312947 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-26b7c3d3-c37a-4415-8057-8792580ef0f8 req-f9af7954-2b1e-4b7d-a1e1-9b18b8bfb6d9 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0290956 Nov 08 04:45:02.402867 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3806bd20-ae3c-42aa-bb79-73d2c3c6c43c req-eb6ce90c-83ee-4e0c-8d16-145350ab08bd tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254388 Nov 08 04:45:03.493149 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-caa089d9-6361-496d-ae01-8f44b6c3ab6f req-2a782bc8-b10e-41bd-8c7b-801704c5388c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260303 Nov 08 04:45:04.587744 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-143e4427-92f6-4777-909f-8c9349b26164 req-9dd179db-f6e4-4d6a-a02a-e6f5225285e8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256095 Nov 08 04:45:05.680175 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-74fe8e16-a0ab-4cf0-bb41-524cb7d7d584 req-bbac1ac0-4b84-403a-9c9e-55590afba7c3 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255616 Nov 08 04:45:06.773381 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-110b2e16-0721-4c00-a82e-dfeac66ff0c7 req-b2eef375-9ce7-431d-aee5-66f0f336dc9d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0273802 Nov 08 04:45:08.027553 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f8f759bc-d999-4545-8944-4a34a58e8c62 req-6b2c5786-d79c-4dea-9eb3-803ad4672d8b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0285072 Nov 08 04:45:09.117833 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ac9cef2-a561-4a28-8ccc-b86c82877908 req-f8849794-d2f7-4549-8629-d5223ba40bf7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260322 Nov 08 04:45:10.210684 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-51e80933-42d5-49b9-b76a-6e5c7c42e8ad req-1ac78e38-4eec-4994-b61c-cb6dc42a9628 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0271699 Nov 08 04:45:11.301086 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-141ab6d2-d7ec-46f6-a4fe-d9fce5bfd729 req-56a48a94-7fc3-46c9-b43d-04dd4bf587f6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252056 Nov 08 04:45:12.391982 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3b9d387d-28bb-402c-aa72-7e1c83768e4b req-c9472640-1d4e-4e8e-8de0-b84002a42278 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256369 Nov 08 04:45:12.652900 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-ba32bc33-6db5-4fd9-9d6c-4a807f4329a6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:13.482457 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-13cd8381-da70-484b-b875-2d5d458fb088 req-6598cdb4-8155-4445-9366-86d60bdfade0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253139 Nov 08 04:45:14.575794 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7a43cca0-7a42-47c7-8f48-2c50229f8e76 req-53e5c4b0-19cf-4c89-934b-40d7c13b734d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0288584 Nov 08 04:45:15.178096 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-db410f3c-f3dd-41fa-8508-e2015e65f2f3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:15.667069 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0c792738-8f51-4035-a36e-52bf5469164a req-4e86a9d4-6cb4-43a6-9d21-9f0cc2757bdc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257523 Nov 08 04:45:16.104345 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:16.763262 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6864063f-c56b-4e48-bddd-1d6a5589783e req-c2e5ac7f-76ce-4161-b7d4-9c0a4c261893 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254927 Nov 08 04:45:16.920621 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:45:17.766448 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:17.855166 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6818c788-de38-4ee6-a49a-fe41240248e0 req-08651902-0cb9-4688-b06b-c78612a40b96 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0251272 Nov 08 04:45:18.441689 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:18.946022 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5a85cf5c-950a-426a-aa56-94c2236faa2c req-313a5d9e-daff-4752-8720-af2e62c07eed tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254545 Nov 08 04:45:20.036908 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5c9f5331-b7a2-47a8-b248-5a88325ba3d9 req-7bf1eedf-fb13-489f-b32f-cc1e5c4e65e6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257859 Nov 08 04:45:21.131402 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-00627b31-9c66-4f55-afe5-c7f4784a960d req-021ad2a8-7e1f-4a29-976d-982f4340e9d8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0285616 Nov 08 04:45:22.346597 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cfd308c1-19b7-4501-99c7-d49d50b63abe req-f343645a-a74b-40aa-bc0b-f1a13270bf1b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0279133 Nov 08 04:45:23.439130 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-101ded47-4d1f-4c65-8521-4ce7d7bd7e24 req-f2476d51-166f-4a5a-9833-2010a311266d tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258048 Nov 08 04:45:24.530794 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ee317ce7-5675-4310-a763-6e532e9f5621 req-1dac4dd7-5c28-4a0b-b332-62d07142d6ec tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255589 Nov 08 04:45:24.558958 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:25.627230 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1a8bf3ba-0262-46e7-bad7-4bcd1e4b627e req-8fc51147-ffa9-44d2-80f9-dc2fc65feb16 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255544 Nov 08 04:45:26.719364 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ea43167a-4c15-4301-92f8-314c536ba0d1 req-dff02a2d-72f8-4aa0-b8ad-80cbea893890 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256059 Nov 08 04:45:27.811743 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ede9b82d-4c29-4c33-91c1-bd54c188d916 req-55aaddb4-d75c-43bb-a358-22a0d489319a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0291803 Nov 08 04:45:28.901160 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-efd23838-c3cb-462d-8029-67105e01e5fd req-2c92dbc5-59db-4982-8147-bf08a0b40b16 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253522 Nov 08 04:45:29.992517 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-70f630df-4772-4cdd-badd-30cf2525ff84 req-0b56cccb-41ed-4cb1-9c65-0b80cb90f1de tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0261767 Nov 08 04:45:31.083464 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-84385fd0-e296-423d-b260-0fe750d6f7b6 req-d00c1639-7708-4efe-b147-76f316478166 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0265961 Nov 08 04:45:32.176205 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c294e80e-312c-47ef-bdd7-fb905acb498e req-16a19e40-d298-4171-84de-3aa6cd070508 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255356 Nov 08 04:45:33.266057 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-79789745-fc88-46a6-8ad6-ac92b02efa33 req-4ab83e10-75ad-4118-b990-d62cc8ab7120 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253186 Nov 08 04:45:34.361053 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4c7e9d10-8960-459d-b977-2e05d82f7e4d req-d253f109-1506-4090-a4e7-93367a30c859 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0303707 Nov 08 04:45:35.452459 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-60d4ca27-ab32-4295-b3fa-39405551ee11 req-25605dac-c08e-40d1-bec4-6aa579923fa7 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254767 Nov 08 04:45:36.542744 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aa3c3328-c5bc-4f8a-8168-6dcea441c827 req-f838367e-b208-4075-82b9-bd06c3d04b19 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255256 Nov 08 04:45:37.638778 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e3a878e0-807f-46f8-a33b-2f3bd76f68fb req-5a8e261b-4164-4265-82fe-03fa6c84dd80 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0283308 Nov 08 04:45:38.729942 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d703bfaf-e5f1-4c90-84e4-022f3bdae26f req-b0b2f5ff-ab11-4485-b497-d8be8a1997cb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258186 Nov 08 04:45:39.819340 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2ddba1f4-300b-4a2d-8c76-2a12d68f47df req-7c1ff8ae-0a82-419c-a006-f1116737edf2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256710 Nov 08 04:45:40.913869 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4153cd72-1bf0-479f-a11b-90ad7ed52c40 req-60fbc5d1-5c4d-4078-86c3-ac9ea97adad4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0289755 Nov 08 04:45:42.003834 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-7f9492b9-7e0f-4bc2-b3df-e8e9028b6134 req-313b4d18-5764-4f6f-b73e-e34f030faa94 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255198 Nov 08 04:45:42.674714 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b94cdd9b-e40f-466f-89a3-c6195deb2f16 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:43.094168 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-34882973-46e5-4942-ae27-6644d2717265 req-9037d402-367e-42f8-8004-d9d0d24e01c4 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0261328 Nov 08 04:45:44.184213 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-50e87a21-681d-45bb-b3c1-a86f7027c238 req-a8c03908-d12f-4e68-8081-7a22f3132481 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258334 Nov 08 04:45:45.160245 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cfb11fb3-7272-443f-be56-435b7ed72faf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:45.275605 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8f7efa94-f4c7-4d15-b1a5-4c17e0f4673b req-65e9ac59-9882-481d-88cf-dd6d1c6c5ef1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0265152 Nov 08 04:45:46.120092 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:46.365427 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-59825e0c-fdf2-4bd7-80e3-22f2f8e4350c req-ef605099-3e72-4fbb-b4eb-80137dc50db0 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256193 Nov 08 04:45:47.465771 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6bf11c08-97f0-48f0-acf1-5db5cf3a709b req-513af230-5b9f-4360-b28c-915f36bea4be tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0324054 Nov 08 04:45:47.788479 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:48.411365 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:48.557140 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4d0d2b5b-15c5-4ffe-b13d-046351f62f9d req-92add295-2a3d-4ea9-9e6e-9e729dc8a689 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0250781 Nov 08 04:45:49.647761 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-ecd9f6f8-e420-420c-95a9-76059fc6d110 req-9aaff3ed-c8f0-4fe4-ad63-e9eb352e14fc tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262089 Nov 08 04:45:50.741213 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8209bf21-af5f-4fcf-8648-ae74a5d79f20 req-3cd3da17-e3b3-4f19-9b7d-edb62d1d1b79 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0259914 Nov 08 04:45:51.833898 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-14a3924a-66ab-42ec-85cd-565a7ae5069d req-1f34a4a7-3c8e-4ac3-94c4-8542050d7779 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0265853 Nov 08 04:45:52.923414 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cca10c7b-0a4f-4d85-a244-f5d8d6e98c86 req-1eab1392-b699-4c12-b3bb-365a05f53348 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256567 Nov 08 04:45:53.919584 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:45:54.016770 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-1e2bb5cc-7bbf-4aae-ad55-eda68fd99956 req-d28cd87e-ea61-45c2-af29-0b3f0ebde949 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0278642 Nov 08 04:45:54.566088 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:45:55.107479 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-6070e491-436f-40a4-86de-1aaec7ca7fef req-b4c493d6-3873-4066-a5c0-aa365f27c8c1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0250537 Nov 08 04:45:56.199315 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c6499acb-ce47-4e70-a0ac-53a662bf2381 req-f3141611-e3d0-494f-8199-56a3359d524c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257721 Nov 08 04:45:57.289801 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2369418a-005b-4453-acd4-acc47b13491c req-71c4068b-056f-4269-b4dc-69b73cf3addd tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256612 Nov 08 04:45:58.381258 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5285a290-93e8-47a0-b674-87c6c2aa6cea req-43f56878-b8fd-48b5-9b52-6dd84168a4e8 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0259311 Nov 08 04:45:59.476015 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-faaeea9d-21ff-4910-984c-da8b1cba8f68 req-a74de3f7-2014-4df3-bcaa-a93a8f4af199 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254698 Nov 08 04:46:00.568614 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-c881e790-9b2d-48e3-b532-4642cbdbc864 req-fa7f4df0-7e50-45ae-bc7a-d3b9872bfe75 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0279338 Nov 08 04:46:01.659518 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-abc73d81-a0c0-4d36-a891-50dfa61dc20d req-86fd6849-c0b2-41d6-91cb-e682adc1647c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257573 Nov 08 04:46:02.758599 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-a2813f58-26aa-4427-8e2a-eb0ea8a9b379 req-35318db4-24e1-415b-9dbc-b3a4ba05e52c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0264821 Nov 08 04:46:03.849238 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-e920ae4f-3090-4a1b-8f37-552f2748628c req-f11d7c3a-bd9f-4494-85d3-95ba011e91eb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0255585 Nov 08 04:46:04.939533 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-85bd7f18-003f-4072-9672-79e40b4c68f4 req-34c9b57a-b962-43a5-9486-ad36951a3962 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0263302 Nov 08 04:46:06.028678 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-72876048-b8c1-43c9-8a9d-bc312b3d790b req-37299d7e-31ac-49d3-9d90-10e8b34962aa tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0256531 Nov 08 04:46:07.123205 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-5b6726b7-8a21-4cb6-8574-d2cbbe681595 req-a65a321e-ceea-4953-b4f5-7bf83a1b66fe tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0296655 Nov 08 04:46:08.213389 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-8d4c1f53-9ded-42f4-9264-51bfbc204f30 req-83698095-3094-4a2d-8cd7-d1f4e222d31c tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254166 Nov 08 04:46:09.306053 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-4232dc86-f8a3-48b3-a8fb-8c95cd003001 req-10cb5dbc-3657-43ec-9bee-186ddb3c7426 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0258458 Nov 08 04:46:10.396780 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-d3e62f6c-b52f-4306-b736-112fe426facb req-98771c59-8109-4d4b-a482-02c657c15e2a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260770 Nov 08 04:46:11.487135 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-2b081ce3-4a98-4333-9577-ce835a9d9fba req-915a2ef7-6150-4aa1-9a57-ebddfa32f097 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0260639 Nov 08 04:46:12.578124 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-bff2e728-28d5-42d9-a002-5b2e80546d19 req-aee011a3-82c1-4140-9bc6-1a573d454c22 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254033 Nov 08 04:46:12.667861 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-446de3fd-9ff1-418c-981c-4519862f6a6e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:13.671488 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-f1c4c37d-82cb-4558-bb9a-269b68fe1444 req-5cf6393a-ab6b-43ba-b61e-ecf0f1be96fb tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0279691 Nov 08 04:46:14.762877 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-cc551ecd-3dc9-43a7-b9ac-05baf37a6db3 req-70b0a984-ef2f-45ef-a9f8-83c82c43b8f6 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0252678 Nov 08 04:46:15.174399 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9cd8528c-2013-4144-aba1-410f2a3de8e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:15.857737 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-aa3efc48-5655-4995-8650-7d91e4f6804f req-f840deda-e22a-481c-a4d1-3704eeedd2e2 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0270424 Nov 08 04:46:16.130575 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:16.949036 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-189a5030-020d-47ab-b4d4-ddfdc5e3293a req-f7c04caa-6339-4bd3-aadd-25ff1519968a tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0257316 Nov 08 04:46:17.797019 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:18.043580 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-0db18ca5-cc31-4eda-9c23-7b58295a289f req-05e6fbcd-51b4-441d-9530-275740e3c032 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0254142 Nov 08 04:46:18.393235 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:19.134537 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-fe47be9b-0674-4c1e-a1c8-858ffe5a7ad7 req-1427d889-4b0f-4762-9bdf-91358b0bbc66 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0253422 Nov 08 04:46:20.227370 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-3ea92b10-153b-446f-a04c-d7d55bc0a4bd req-d19e43c7-8386-4a1c-ad31-9c5680f402ca tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0287373 Nov 08 04:46:21.320710 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-88e99f00-b84e-43b0-acc1-8f4f9f82b068 req-42b489b9-9d99-45bc-91fa-d249100b8a0e tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0270276 Nov 08 04:46:22.411788 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [req-780c4125-2ae3-4b12-a838-015f3d3774de req-696f5ba2-8402-4ef3-8307-a7df7cdf6a31 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "GET /v2.0/ports?device_id=7d56d482-c782-406d-84dd-036e79b29b4a HTTP/1.1" status: 200 len: 210 time: 0.0262747 Nov 08 04:46:22.432273 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 36356) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:46:22.552066 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Deleting port ee079b89-6120-4191-934c-66e56a75fbe4 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:46:22.552401 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:22.627705 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:22.627962 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:22.639658 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Calling delete_port for ee079b89-6120-4191-934c-66e56a75fbe4 owned by network:floatingip {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:46:22.839001 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:22.865844 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event deleted for resources: {'Port': ['ID=ee079b89-6120-4191-934c-66e56a75fbe4,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:46:22.880447 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.880739 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.881080 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.881418 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.881750 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.882081 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.882420 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.882775 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.883101 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.883426 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.883748 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.884066 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:46:22.936935 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for floatingip, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:22.940071 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-154523'] for floatingip, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:22.944011 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-95cfbf2c-fdcc-49e2-a537-3e4978d366f1 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "DELETE /v2.0/floatingips/a902f47b-ca98-4cce-a6ab-f1dcc615bfa4 HTTP/1.1" status: 204 len: 168 time: 0.5080090 Nov 08 04:46:24.558881 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:30.918315 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:46:42.665059 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9342cc22-7ebc-4509-9250-becf0e18fb46 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:45.169970 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-36a753cb-7d23-4e26-b3a7-d1b3cc0016fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:46.127798 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:47.781517 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:48.409338 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:46:54.603750 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:07.917205 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:47:12.689198 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-42ff041b-3f07-48a5-922d-e09bf0656c89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:15.180328 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-386da6aa-48ef-4c8f-a135-57936f3842f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:16.133563 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:17.772604 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:18.452639 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:24.608684 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:42.663500 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f2598e4e-5a8e-4a5e-a7b6-1979b840def0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:44.916241 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:47:45.188840 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9a1075a5-b15e-47e3-ae4f-54eacca0b759 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:46.139331 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:47.767694 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:48.418937 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:47:54.602263 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:12.671122 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-972f67f8-8fcf-40fe-8eb3-4b5e016a8b2a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:15.190889 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c8c67d0c-aa3b-408b-ac52-f8e1a71fd2d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:16.122587 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:17.785675 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:18.397345 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:21.914939 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:48:24.597103 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:42.671586 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a078a492-d318-4936-ae1a-c59c1c69407a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:45.185985 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-074cc93c-c220-4d81-bebe-42aadd6b9c55 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:46.146349 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:47.785519 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:48.386558 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:54.598117 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:48:58.913980 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:49:12.678234 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-4f577054-b0b4-4e11-a2fb-847314bd92f8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:15.185922 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-9c33fb42-5b86-40c6-9753-63cff7421ce5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:16.146747 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:17.786844 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:18.426926 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:24.633000 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:35.913026 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:49:42.684524 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-69f0ef53-bc10-4974-9ec6-a25927aec8b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:45.176020 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c91a8397-fc3c-4179-923c-b798ca8c1df3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:46.130157 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:47.798860 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:48.427815 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:49:54.662626 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:12.656755 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f4f5a21c-832d-431b-aff0-e727ddb0fa82 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:12.912027 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:50:15.194066 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-44daea8b-4891-4aca-a5a1-cd9e94cc8495 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:16.142425 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:17.799753 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:18.399329 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:24.691233 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:42.691848 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-6e04b18e-72f6-4368-a18b-198784537ef3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:45.200220 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-bbbeabd1-c4b6-4205-a3b1-6e1dfb223c64 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:46.159879 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:47.799496 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:48.388319 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:50:49.910526 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:50:54.680275 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:12.674490 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-57ebb6e5-54b9-4bda-bd22-66f54c02e0b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:15.182867 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1a77713a-bbf2-4b86-b856-1ad0c234e4eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:16.154935 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:17.811903 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:18.400417 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:24.668748 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:26.908566 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:51:42.703302 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-4168cea3-816a-4008-97b1-f5d6a79c11a9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:45.206110 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c8566741-0be0-40ee-97ae-d48938784eaa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:46.160846 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:47.817864 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:48.400740 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:51:54.726082 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:03.906250 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:52:12.709255 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8469ae24-d36e-43a4-a98e-09a3609e0b70 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:15.195072 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-63a17cc1-ed5e-43f4-ab9f-1817beba62bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:16.155319 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:17.840961 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:18.407057 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:23.953919 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37366) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:24.011075 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:24.036218 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:24.166809 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:24.169250 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:24.170433 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] 10.222.0.21 "DELETE /v2.0/security-groups/b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb HTTP/1.1" status: 204 len: 168 time: 0.2154880 Nov 08 04:52:24.179437 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2d3fbbc-fa9c-42b0-aecc-22abb05a32cb,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:24.189422 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.190052 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.190216 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.190443 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.190789 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.191113 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.191702 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.192021 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.192337 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.192656 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.192969 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.193284 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51b50c1f-2738-4685-ab72-fe9570d4447b tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:24.554048 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37374) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:24.704160 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:25.095981 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-703381'] for router_interface, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:25.340528 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] Deleting port 4bdbd0d3-4329-4622-9ed1-490362f49e30 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:52:25.340856 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:25.421027 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] For port 4bdbd0d3-4329-4622-9ed1-490362f49e30, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=4bdbd0d3-4329-4622-9ed1-490362f49e30,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:52:25.421446 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:25.433987 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] Calling delete_port for 4bdbd0d3-4329-4622-9ed1-490362f49e30 owned by network:router_interface {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:52:25.658377 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:25.683715 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] Pushing event deleted for resources: {'Port': ['ID=4bdbd0d3-4329-4622-9ed1-490362f49e30,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:25.843663 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530978', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-703013'] for router_interface, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:26.049262 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] Router 8aa2c265-b728-4ac3-97de-f276d80d2037 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:52:26.150411 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:52:26.155477 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-5d0d864d-7483-47f1-ab57-65b268d51d79 admin admin] 10.222.0.21 "PUT /v2.0/routers/8aa2c265-b728-4ac3-97de-f276d80d2037/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5998204 Nov 08 04:52:26.157843 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37382) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:26.160491 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] Sync routers for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:52:26.171011 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:52:26.171622 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:52:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:26.262987 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Publish callbacks [] for router, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:26.275720 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:52:26.361747 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:26.449916 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70'}], 'enable_snat': True}, 'gw_port_id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:52:25Z', 'revision_number': 5, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port': {'id': '38a2e2c4-b937-4b0b-b49d-6dbbc4e31925', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:a5:92:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'device_owner': 'network:router_gateway', 'standard_attr_id': 332, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:19Z', 'updated_at': '2021-11-08T04:14:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:26.474764 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] Checking router: 8aa2c265-b728-4ac3-97de-f276d80d2037 for host: dv-cinder-783643-4-iscsi {{(pid=101666) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:52:26.482795 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Deleting port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:52:26.483137 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:26.483329 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] Routers {'8aa2c265-b728-4ac3-97de-f276d80d2037'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101666) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:52:26.483908 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:52:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['8aa2c265-b728-4ac3-97de-f276d80d2037'], 'active': True} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:26.559525 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] For port 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=38a2e2c4-b937-4b0b-b49d-6dbbc4e31925,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:52:26.560320 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:26.568062 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvr_db [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] Set router 8aa2c265-b728-4ac3-97de-f276d80d2037 gateway port host: None {{(pid=101666) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:52:26.576117 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Calling delete_port for 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 owned by network:router_gateway {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:52:26.622580 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_hamode_db [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:52:26Z', 'revision_number': 6, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port_host': None}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101666) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:26.647629 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dba3a5a8-f21e-408e-a56a-052b10395935 None None] The sync data for ids ['8aa2c265-b728-4ac3-97de-f276d80d2037'] in dv-cinder-783643-4-iscsi is: [{'id': '8aa2c265-b728-4ac3-97de-f276d80d2037', 'name': 'tempest-TestVolumeBootPattern-2112909676-router', 'tenant_id': 'aa58a6fe20a449858977c517ca68518b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:18Z', 'updated_at': '2021-11-08T04:52:26Z', 'revision_number': 6, 'project_id': 'aa58a6fe20a449858977c517ca68518b', 'gw_port_host': None}] {{(pid=101666) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:52:26.812569 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.105556 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Pushing event deleted for resources: {'Port': ['ID=38a2e2c4-b937-4b0b-b49d-6dbbc4e31925,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:27.162214 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-688863'] for router_gateway, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.252620 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-700541', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7524'] for router, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.254655 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.367621 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-700518'] for router, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.368064 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8aa2c265-b728-4ac3-97de-f276d80d2037 {{(pid=101665) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 04:52:27.372399 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] Publish callbacks [] for router, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.373429 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-58d5a226-e06a-4a85-964d-17a03f21b23c admin admin] 10.222.0.21 "DELETE /v2.0/routers/8aa2c265-b728-4ac3-97de-f276d80d2037 HTTP/1.1" status: 204 len: 168 time: 1.2146909 Nov 08 04:52:27.375870 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37386) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:27.419561 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_v2 [None req-bb54ffe2-e923-4c86-85c0-feb5fdc59051 admin admin] Deleting subnet 5926063e-8f31-4623-9cfc-4a0b577bdb41 {{(pid=101665) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:52:27.422891 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb54ffe2-e923-4c86-85c0-feb5fdc59051 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.456851 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb54ffe2-e923-4c86-85c0-feb5fdc59051 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4636238'] for subnet, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.533723 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb54ffe2-e923-4c86-85c0-feb5fdc59051 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.641653 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb54ffe2-e923-4c86-85c0-feb5fdc59051 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6273036', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4372241'] for subnet, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.670887 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-bb54ffe2-e923-4c86-85c0-feb5fdc59051 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.674822 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-bb54ffe2-e923-4c86-85c0-feb5fdc59051 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/5926063e-8f31-4623-9cfc-4a0b577bdb41 HTTP/1.1" status: 204 len: 168 time: 0.2979410 Nov 08 04:52:27.675824 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb54ffe2-e923-4c86-85c0-feb5fdc59051 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5926063e-8f31-4623-9cfc-4a0b577bdb41,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:27.676209 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6d88f0f-83c8-4c7f-b2ba-108c427cebbb None None] Network 16cbde97-55ea-47f6-bd55-cf46e7c41a49 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:52:27.679282 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 37388) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:27.756096 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.808606 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Deleting port b32ebd58-f404-4758-8887-7264a2e490fc {{(pid=101664) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:52:27.810902 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.864294 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] DHCP port deletion for 16cbde97-55ea-47f6-bd55-cf46e7c41a49 request from dv-cinder-783643-4-iscsi {{(pid=101666) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 04:52:27.879242 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.db [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] For port b32ebd58-f404-4758-8887-7264a2e490fc, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=b32ebd58-f404-4758-8887-7264a2e490fc,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101664) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:52:27.879242 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.890408 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.plugin [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Calling delete_port for b32ebd58-f404-4758-8887-7264a2e490fc owned by network:dhcp {{(pid=101664) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:52:27.909917 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Deleting port b32ebd58-f404-4758-8887-7264a2e490fc {{(pid=101666) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:52:27.914288 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.976777 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] For port b32ebd58-f404-4758-8887-7264a2e490fc, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=b32ebd58-f404-4758-8887-7264a2e490fc,segment=NetworkSegment(45e39c1d-17e6-4d15-9e5d-2931daeb0af1),segment_id=45e39c1d-17e6-4d15-9e5d-2931daeb0af1)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:52:27.976777 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:27.986414 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Calling delete_port for b32ebd58-f404-4758-8887-7264a2e490fc owned by network:dhcp {{(pid=101666) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:52:28.052910 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5120808'] for port, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:28.059622 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522'] for port, after_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:28.078408 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Pushing event deleted for resources: {'Port': ['ID=b32ebd58-f404-4758-8887-7264a2e490fc,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:28.082772 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] No DVR routers for this DVR port b32ebd58-f404-4758-8887-7264a2e490fc on host dv-cinder-783643-4-iscsi {{(pid=101664) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:52:28.083634 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Pushing event deleted for resources: {'Port': ['ID=b32ebd58-f404-4758-8887-7264a2e490fc,revision_number=None']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:28.090584 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.090938 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.091106 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] No DVR routers for this DVR port b32ebd58-f404-4758-8887-7264a2e490fc on host dv-cinder-783643-4-iscsi {{(pid=101666) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:52:28.091309 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.091700 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.092393 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.092393 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.092603 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.092896 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.093119 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.093250 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.093465 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.093579 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.093803 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.093925 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.094137 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.094270 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.094471 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.094880 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.095180 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.095461 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.095783 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.096502 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.096502 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.096720 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99ea0dd7-1fe4-4c39-b8b9-e87555171d14 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101666) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:52:28.165058 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:28.184057 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['16cbde97-55ea-47f6-bd55-cf46e7c41a49']}} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:28.193100 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '45e39c1d-17e6-4d15-9e5d-2931daeb0af1') {'for_net_delete': True} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:28.193385 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '45e39c1d-17e6-4d15-9e5d-2931daeb0af1') {} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:28.202636 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6285915'] for segment, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:28.215777 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:28.221702 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Releasing vlan 186 on physical network physnet1 to pool {{(pid=101664) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:52:28.222083 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5120795'] for segment, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: Traceback (most recent call last): Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: timer() Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: cb(*args, **kw) Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: return func(*args, **kwargs) Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: self._notify() Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: self.callback(batched_events) Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: event.method(event) Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: return f(self, *a, **k) Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._get(url).json() Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: return self.request(url, 'GET', **kwargs) Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:52:28.223911 dv-cinder-783643-4-iscsi neutron-server[101664]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:52:28.275769 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:52:28.299863 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:52:28.300210 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 38a2e2c4-b937-4b0b-b49d-6dbbc4e31925 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:52:28.300628 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 4bdbd0d3-4329-4622-9ed1-490362f49e30 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:52:28.319110 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 4bdbd0d3-4329-4622-9ed1-490362f49e30 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:52:28.319400 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 4bdbd0d3-4329-4622-9ed1-490362f49e30 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:52:28.319907 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device b32ebd58-f404-4758-8887-7264a2e490fc no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:52:28.338171 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: b32ebd58-f404-4758-8887-7264a2e490fc {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:52:28.338530 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device b32ebd58-f404-4758-8887-7264a2e490fc not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:52:28.355573 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:28.359707 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:28.362931 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] 10.222.0.21 "DELETE /v2.0/networks/16cbde97-55ea-47f6-bd55-cf46e7c41a49 HTTP/1.1" status: 204 len: 168 time: 0.6801054 Nov 08 04:52:28.365890 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37394) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:28.375429 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ffd8b0b-83c9-43af-8268-68fcd4c18f69 admin admin] Pushing event deleted for resources: {'Network': ['ID=16cbde97-55ea-47f6-bd55-cf46e7c41a49,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:28.700154 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-703381'] for router_interface, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:28.931563 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] Deleting port 0cd56535-8b05-4a35-bc64-4224a5f89118 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:52:28.931902 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:29.009691 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] For port 0cd56535-8b05-4a35-bc64-4224a5f89118, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=0cd56535-8b05-4a35-bc64-4224a5f89118,segment=NetworkSegment(9aaa3351-d0b4-46e7-bff2-5b43e82306c5),segment_id=9aaa3351-d0b4-46e7-bff2-5b43e82306c5)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:52:29.010092 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:29.021860 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] Calling delete_port for 0cd56535-8b05-4a35-bc64-4224a5f89118 owned by network:router_interface {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:52:29.275667 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:29.300538 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] Pushing event deleted for resources: {'Port': ['ID=0cd56535-8b05-4a35-bc64-4224a5f89118,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:29.468885 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530978', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-703013'] for router_interface, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:29.671967 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] Router dbf47dba-2137-4db8-a25b-98db4696ddc4 has already been hosted by L3 agent 87c78e9c-88f2-4103-b6d6-3b080beae946 {{(pid=101665) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 08 04:52:29.777067 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] Notify agent at l3_agent.dv-cinder-783643-4-iscsi the message routers_updated {{(pid=101665) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 08 04:52:29.784695 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-c1013969-5d6d-4a92-9c20-eaa120bf96ca admin admin] 10.222.0.21 "PUT /v2.0/routers/dbf47dba-2137-4db8-a25b-98db4696ddc4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4150980 Nov 08 04:52:29.784809 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37398) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:29.785529 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] Sync routers for ids ['dbf47dba-2137-4db8-a25b-98db4696ddc4'] in dv-cinder-783643-4-iscsi {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 08 04:52:29.795508 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] Routers {'dbf47dba-2137-4db8-a25b-98db4696ddc4'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:52:29.796168 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:52:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['dbf47dba-2137-4db8-a25b-98db4696ddc4'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:29.886383 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Publish callbacks [] for router, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:29.895348 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] Set router dbf47dba-2137-4db8-a25b-98db4696ddc4 gateway port host: dv-cinder-783643-4-iscsi {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:52:29.989743 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.074508 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'name': 'tempest-TestVolumeBootPattern-837607712-router', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'external_fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49'}], 'enable_snat': True}, 'gw_port_id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:28Z', 'updated_at': '2021-11-08T04:52:29Z', 'revision_number': 5, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'gw_port': {'id': 'c08b9ee1-e152-4ab8-a625-655bb485f35b', 'name': '', 'network_id': '5f8893ec-e63f-48c2-bd9f-ad47bb1b4da4', 'tenant_id': '', 'mac_address': 'fa:16:3e:12:c1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 349, 'fixed_ips': [{'subnet_id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'ip_address': '172.27.2.49', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-783643-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-08T04:14:29Z', 'updated_at': '2021-11-08T04:14:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd4daf4b1-2c47-4c16-a8ea-4d93b75219c9', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-783643-4-iscsi'}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:30.100444 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] Checking router: dbf47dba-2137-4db8-a25b-98db4696ddc4 for host: dv-cinder-783643-4-iscsi {{(pid=101667) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 08 04:52:30.110185 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] Routers {'dbf47dba-2137-4db8-a25b-98db4696ddc4'} bound to L3 agent in host dv-cinder-783643-4-iscsi {{(pid=101667) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 08 04:52:30.110822 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-783643-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-08T04:02:45Z,description=,heartbeat_timestamp=2021-11-08T04:52:15Z,host='dv-cinder-783643-4-iscsi',id=87c78e9c-88f2-4103-b6d6-3b080beae946,load=0,resource_versions=,resources_synced=,started_at=2021-11-08T04:02:46Z,topic='l3_agent')) {'router_ids': ['dbf47dba-2137-4db8-a25b-98db4696ddc4'], 'active': True} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:30.125111 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Deleting port c08b9ee1-e152-4ab8-a625-655bb485f35b {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:52:30.125451 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.197564 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_dvr_db [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] Set router dbf47dba-2137-4db8-a25b-98db4696ddc4 gateway port host: None {{(pid=101667) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 08 04:52:30.205109 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] For port c08b9ee1-e152-4ab8-a625-655bb485f35b, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=c08b9ee1-e152-4ab8-a625-655bb485f35b,segment=NetworkSegment(9577efe5-3511-40fe-9ebe-e6ea7e63ac49),segment_id=9577efe5-3511-40fe-9ebe-e6ea7e63ac49)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:52:30.205492 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.218957 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Calling delete_port for c08b9ee1-e152-4ab8-a625-655bb485f35b owned by network:router_gateway {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:52:30.250376 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.l3_hamode_db [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'name': 'tempest-TestVolumeBootPattern-837607712-router', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:28Z', 'updated_at': '2021-11-08T04:52:29Z', 'revision_number': 6, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'gw_port_host': None}], 'dv-cinder-783643-4-iscsi', False) {} {{(pid=101667) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:30.277233 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6caea57-c5fd-4f51-8749-7e7fe6b888df None None] The sync data for ids ['dbf47dba-2137-4db8-a25b-98db4696ddc4'] in dv-cinder-783643-4-iscsi is: [{'id': 'dbf47dba-2137-4db8-a25b-98db4696ddc4', 'name': 'tempest-TestVolumeBootPattern-837607712-router', 'tenant_id': '304c339eba1f44e2a3de7346f1de0b29', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-08T04:14:28Z', 'updated_at': '2021-11-08T04:52:29Z', 'revision_number': 6, 'project_id': '304c339eba1f44e2a3de7346f1de0b29', 'gw_port_host': None}] {{(pid=101667) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 08 04:52:30.441805 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.467412 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Pushing event deleted for resources: {'Port': ['ID=c08b9ee1-e152-4ab8-a625-655bb485f35b,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:30.528108 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-688863'] for router_gateway, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.613258 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-700541', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-7524'] for router, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.615432 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.738732 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-700518'] for router, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.739197 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Fanout notify agent at l3_agent the message router_deleted on router dbf47dba-2137-4db8-a25b-98db4696ddc4 {{(pid=101665) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 08 04:52:30.744326 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] Publish callbacks [] for router, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.745476 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-14856154-5dcf-4b32-90cd-9f0a4f32d219 admin admin] 10.222.0.21 "DELETE /v2.0/routers/dbf47dba-2137-4db8-a25b-98db4696ddc4 HTTP/1.1" status: 204 len: 168 time: 0.9597845 Nov 08 04:52:30.748060 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37402) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:30.796044 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_v2 [None req-f0ffd45a-ac40-46e3-aaee-40a94d40d4a5 admin admin] Deleting subnet d7135ca5-abad-42c8-9fca-b5f1575cea78 {{(pid=101665) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:52:30.799121 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f0ffd45a-ac40-46e3-aaee-40a94d40d4a5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.832585 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f0ffd45a-ac40-46e3-aaee-40a94d40d4a5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4636238'] for subnet, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:30.908691 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f0ffd45a-ac40-46e3-aaee-40a94d40d4a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.031224 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f0ffd45a-ac40-46e3-aaee-40a94d40d4a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6273036', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4372241'] for subnet, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.055805 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0ffd45a-ac40-46e3-aaee-40a94d40d4a5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d7135ca5-abad-42c8-9fca-b5f1575cea78,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:31.061581 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-f0ffd45a-ac40-46e3-aaee-40a94d40d4a5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.064888 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-f0ffd45a-ac40-46e3-aaee-40a94d40d4a5 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/d7135ca5-abad-42c8-9fca-b5f1575cea78 HTTP/1.1" status: 204 len: 168 time: 0.3159101 Nov 08 04:52:31.068032 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37406) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:31.069592 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40618954-0917-467b-aca9-49b81d192b5f None None] Network 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 requested from dv-cinder-783643-4-iscsi {{(pid=101666) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 08 04:52:31.144724 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.196755 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Deleting port d0eab8ec-dcd7-4727-a451-ac703861b605 {{(pid=101665) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:52:31.197097 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.258085 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27d0023c-6bb4-4002-b397-7f3c376945ae None None] DHCP port deletion for 2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 request from dv-cinder-783643-4-iscsi {{(pid=101666) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 08 04:52:31.272108 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.db [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] For port d0eab8ec-dcd7-4727-a451-ac703861b605, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=d0eab8ec-dcd7-4727-a451-ac703861b605,segment=NetworkSegment(9aaa3351-d0b4-46e7-bff2-5b43e82306c5),segment_id=9aaa3351-d0b4-46e7-bff2-5b43e82306c5)] {{(pid=101665) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:52:31.272484 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.289417 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.plugin [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Calling delete_port for d0eab8ec-dcd7-4727-a451-ac703861b605 owned by network:dhcp {{(pid=101665) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:52:31.310530 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-27d0023c-6bb4-4002-b397-7f3c376945ae None None] Deleting port d0eab8ec-dcd7-4727-a451-ac703861b605 {{(pid=101666) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 08 04:52:31.310893 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-27d0023c-6bb4-4002-b397-7f3c376945ae None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8785436134072'] for port, before_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.376567 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.db [None req-27d0023c-6bb4-4002-b397-7f3c376945ae None None] For port d0eab8ec-dcd7-4727-a451-ac703861b605, host dv-cinder-783643-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-783643-4-iscsi',level=0,port_id=d0eab8ec-dcd7-4727-a451-ac703861b605,segment=NetworkSegment(9aaa3351-d0b4-46e7-bff2-5b43e82306c5),segment_id=9aaa3351-d0b4-46e7-bff2-5b43e82306c5)] {{(pid=101666) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 08 04:52:31.376961 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-27d0023c-6bb4-4002-b397-7f3c376945ae None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-693811'] for port, precommit_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.388897 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-27d0023c-6bb4-4002-b397-7f3c376945ae None None] Calling delete_port for d0eab8ec-dcd7-4727-a451-ac703861b605 owned by network:dhcp {{(pid=101666) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 08 04:52:31.436043 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-6273241'] for port, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.459061 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Pushing event deleted for resources: {'Port': ['ID=d0eab8ec-dcd7-4727-a451-ac703861b605,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:31.462857 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-27d0023c-6bb4-4002-b397-7f3c376945ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1631388', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-456590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8785436140162', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8785435675522'] for port, after_delete {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.465238 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] No DVR routers for this DVR port d0eab8ec-dcd7-4727-a451-ac703861b605 on host dv-cinder-783643-4-iscsi {{(pid=101665) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:52:31.495457 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27d0023c-6bb4-4002-b397-7f3c376945ae None None] Pushing event deleted for resources: {'Port': ['ID=d0eab8ec-dcd7-4727-a451-ac703861b605,revision_number=None']} {{(pid=101666) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:31.499973 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27d0023c-6bb4-4002-b397-7f3c376945ae None None] No DVR routers for this DVR port d0eab8ec-dcd7-4727-a451-ac703861b605 on host dv-cinder-783643-4-iscsi {{(pid=101666) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 08 04:52:31.538152 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.556952 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9']}} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:31.565713 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9aaa3351-d0b4-46e7-bff2-5b43e82306c5') {'for_net_delete': True} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:31.566001 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.services.segments.db [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9aaa3351-d0b4-46e7-bff2-5b43e82306c5') {} {{(pid=101665) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:52:31.575677 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4636247'] for segment, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.589728 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.595542 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Releasing vlan 182 on physical network physnet1 to pool {{(pid=101665) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-6273258'] for segment, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: Traceback (most recent call last): Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: timer() Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: cb(*args, **kw) Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: return func(*args, **kwargs) Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: self._notify() Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: self.callback(batched_events) Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: event.method(event) Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: return f(self, *a, **k) Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._get(url).json() Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: return self.request(url, 'GET', **kwargs) Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:52:31.599798 dv-cinder-783643-4-iscsi neutron-server[101665]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:52:31.721362 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.726624 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:31.729672 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] 10.222.0.21 "DELETE /v2.0/networks/2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9 HTTP/1.1" status: 204 len: 168 time: 0.6605136 Nov 08 04:52:31.739648 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2997e604-85ef-40c6-8e0a-33112f782d81 admin admin] Pushing event deleted for resources: {'Network': ['ID=2fc4cb5c-eb4b-4618-ba31-5b0e91683fb9,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:32.106413 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37412) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:32.145121 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-df9e66ea-e261-4a3d-847f-0705202a4cb9 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=aa58a6fe20a449858977c517ca68518b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0375838 Nov 08 04:52:32.147399 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37414) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:32.191682 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-52ede460-af55-4e85-af0e-41990b12901d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:32.212173 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-52ede460-af55-4e85-af0e-41990b12901d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:32.269520 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0cd56535-8b05-4a35-bc64-4224a5f89118 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:52:32.289481 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: 0cd56535-8b05-4a35-bc64-4224a5f89118 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:52:32.293059 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device 0cd56535-8b05-4a35-bc64-4224a5f89118 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:52:32.293059 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device c08b9ee1-e152-4ab8-a625-655bb485f35b no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:52:32.309078 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: c08b9ee1-e152-4ab8-a625-655bb485f35b {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:52:32.311082 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device c08b9ee1-e152-4ab8-a625-655bb485f35b not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:52:32.311082 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device d0eab8ec-dcd7-4727-a451-ac703861b605 no longer exists at agent ovs-agent-dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 08 04:52:32.328155 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.plugin [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] No Port match for: d0eab8ec-dcd7-4727-a451-ac703861b605 {{(pid=101666) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 08 04:52:32.328513 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron.plugins.ml2.rpc [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Device d0eab8ec-dcd7-4727-a451-ac703861b605 not bound to the agent host dv-cinder-783643-4-iscsi {{(pid=101666) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 08 04:52:32.350012 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-52ede460-af55-4e85-af0e-41990b12901d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:32.353158 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-52ede460-af55-4e85-af0e-41990b12901d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:32.354338 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-52ede460-af55-4e85-af0e-41990b12901d admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/22c8203d-3e2c-47a8-a396-c049fabeeaaa HTTP/1.1" status: 204 len: 168 time: 0.2060733 Nov 08 04:52:32.363233 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52ede460-af55-4e85-af0e-41990b12901d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22c8203d-3e2c-47a8-a396-c049fabeeaaa,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:32.914256 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37420) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:32.952605 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-00deb53d-7e4a-4545-8a2f-fff1a076cefc admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=304c339eba1f44e2a3de7346f1de0b29&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0366063 Nov 08 04:52:32.954975 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37422) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:52:33.003792 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d305a1f3-13f2-4739-9144-a58d2363f5d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:33.024924 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d305a1f3-13f2-4739-9144-a58d2363f5d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:33.144397 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d305a1f3-13f2-4739-9144-a58d2363f5d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:33.147031 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d305a1f3-13f2-4739-9144-a58d2363f5d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:33.148171 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-d305a1f3-13f2-4739-9144-a58d2363f5d6 admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/764024bd-c96e-4f01-a3d0-a3c3ff1e8311 HTTP/1.1" status: 204 len: 168 time: 0.1922960 Nov 08 04:52:33.156313 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d305a1f3-13f2-4739-9144-a58d2363f5d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=764024bd-c96e-4f01-a3d0-a3c3ff1e8311,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:52:40.904846 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:52:42.641359 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-61de47c9-e661-423e-a7ba-c1222f135d02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:45.195301 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-eb5e2c1a-7f9c-4c9e-847d-917ce9a18c1e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:46.160901 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:47.823954 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:48.400948 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:52:54.703922 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:12.693002 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7ef4a08d-36d4-457f-a5d8-22a621426755 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:15.178410 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a66e5dd1-b18b-4a50-9605-8c41f4912793 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:16.161710 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:17.813374 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:17.903173 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:53:18.396018 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:24.733079 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.040837 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [-] (101665) accepted ('10.222.0.21', 37604) {{(pid=101665) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:53:29.223493 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.db.db_base_plugin_v2 [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Deleting subnet b7476cdf-e453-4db0-a095-7baf9278351d {{(pid=101665) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 08 04:53:29.226391 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.259146 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4636238'] for subnet, precommit_delete_associations {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.306944 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1916964'] for subnet, precommit_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.430451 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1916973', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-747590', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-6273036', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-4372241'] for subnet, after_delete {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.455561 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b7476cdf-e453-4db0-a095-7baf9278351d,revision_number=None']} {{(pid=101665) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:53:29.460033 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron_lib.callbacks.manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101665) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.463296 dv-cinder-783643-4-iscsi neutron-server[101665]: INFO neutron.wsgi [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] 10.222.0.21 "DELETE /v2.0/subnets/b7476cdf-e453-4db0-a095-7baf9278351d HTTP/1.1" status: 204 len: 168 time: 0.4214675 Nov 08 04:53:29.466056 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 37610) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:53:29.468759 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.469096 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.469444 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.469774 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.470100 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.470423 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.477869 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.477869 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.477869 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.477869 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.477869 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.477869 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5bcddb2-1149-4a77-a733-00c52cccc068 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101665) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.536590 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1602241'] for network, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.613822 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1918289', 'neutron.services.segments.db._delete_segments_for_network-8785436166449'] for network, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.633133 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9f4f71e5-fbed-4c5a-b59e-c195c2501dbb']}} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:53:29.642651 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a422b515-4eaf-4235-a3e4-a2fa0790f882') {'for_net_delete': True} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:53:29.642943 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.services.segments.db [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a422b515-4eaf-4235-a3e4-a2fa0790f882') {} {{(pid=101664) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 08 04:53:29.651719 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8785436166970', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-6285915'] for segment, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.663930 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973'] for segment, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.669549 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Releasing vlan 191 on physical network physnet1 to pool {{(pid=101664) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 08 04:53:29.669920 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1919973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5120795'] for segment, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: Traceback (most recent call last): Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: timer() Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: cb(*args, **kw) Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: return func(*args, **kwargs) Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: self._notify() Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: self.callback(batched_events) Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: event.method(event) Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: aggregate_uuid = self.p_client.list_aggregates( Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: return f(self, *a, **k) Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._get(url).json() Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: return self.request(url, 'GET', **kwargs) Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: base_url = self.get_endpoint(auth, allow=allow, Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 08 04:53:29.671578 dv-cinder-783643-4-iscsi neutron-server[101664]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 08 04:53:29.773167 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1918626', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-777005', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-531161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-688803'] for network, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.778455 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-531151'] for network, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:29.781586 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] 10.222.0.21 "DELETE /v2.0/networks/9f4f71e5-fbed-4c5a-b59e-c195c2501dbb HTTP/1.1" status: 204 len: 168 time: 0.3139181 Nov 08 04:53:29.791809 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Pushing event deleted for resources: {'Network': ['ID=9f4f71e5-fbed-4c5a-b59e-c195c2501dbb,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:53:29.798812 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.801348 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.801348 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.801348 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.801348 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.801348 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.801348 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.801348 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.801348 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.802244 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.802244 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:29.802244 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64d9b4c5-9046-4d5a-a859-9821f45718d1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-783643-4-iscsi {{(pid=101664) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 08 04:53:30.070909 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 37616) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:53:30.108256 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-e75966dc-de5b-4c0d-8488-6ec558863152 admin admin] 10.222.0.21 "GET /v2.0/security-groups?tenant_id=8e5d49c7aaba44d380042cbff995c227&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0362608 Nov 08 04:53:30.110596 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.wsgi [-] (101664) accepted ('10.222.0.21', 37618) {{(pid=101664) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 08 04:53:30.158119 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-63c24d60-f7e7-4049-bc6a-eed189fb046c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:30.178344 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-63c24d60-f7e7-4049-bc6a-eed189fb046c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:30.281003 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-63c24d60-f7e7-4049-bc6a-eed189fb046c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-770970'] for security_group, after_delete {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:30.283496 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron_lib.callbacks.manager [None req-63c24d60-f7e7-4049-bc6a-eed189fb046c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101664) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:30.284623 dv-cinder-783643-4-iscsi neutron-server[101664]: INFO neutron.wsgi [None req-63c24d60-f7e7-4049-bc6a-eed189fb046c admin admin] 10.222.0.21 "DELETE /v2.0/security-groups/a220d54b-4cb8-4da5-9576-a2b4fcf6fa49 HTTP/1.1" status: 204 len: 168 time: 0.1731741 Nov 08 04:53:30.294079 dv-cinder-783643-4-iscsi neutron-server[101664]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63c24d60-f7e7-4049-bc6a-eed189fb046c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a220d54b-4cb8-4da5-9576-a2b4fcf6fa49,revision_number=None']} {{(pid=101664) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 08 04:53:42.703836 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f20dbcd7-78ee-494e-98b6-b915867ae3e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:45.184583 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5da7cf5e-08d1-4e20-8778-e9749ff374a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:46.156870 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:47.813229 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:48.413010 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:54.767659 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:53:54.902423 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:54:12.670567 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-3ba4f020-fa1e-453d-be8d-cfd8157df88c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:15.189409 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-5aecbaca-d195-45eb-9958-2e62d2c29453 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:16.190503 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:17.824041 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:18.391106 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:24.750353 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:31.900893 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:54:42.663955 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-d4fd6a85-8bdb-4e67-8cea-698d68c38f85 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:45.179367 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-b0acb94c-cd13-41af-9b3c-9c2e1fada569 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:46.167677 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:47.801900 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:48.379117 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:54:54.756855 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:08.900246 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:55:12.694055 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a2972155-7c85-4e2e-a57d-3f96137d865b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:15.184254 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-1be4aca4-fcf9-4344-945a-2cd2bc6d14ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:16.174108 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:17.830212 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:18.389667 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:23.153952 dv-cinder-783643-4-iscsi neutron-server[101665]: DEBUG neutron.wsgi [req-beb10485-a78f-4332-8e04-88d11acf1239 req-2aa77af9-caae-4adc-a27a-da8a083603a5 tempest-TestVolumeBootPattern-1624111843 tempest-TestVolumeBootPattern-1624111843-project] (101665) timed out ('10.222.0.16', 51205) {{(pid=101665) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 08 04:55:24.773479 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:42.665115 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-dc0f9cb3-fb8a-4464-90c3-eb2d8754e5d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:45.189520 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-20888252-ae69-47ff-8aa1-c24fb51480ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:45.900566 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:55:46.185116 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:47.813728 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:48.394889 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:55:54.768589 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:12.688375 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-47ded1f6-4756-4a2e-8671-87ffcb49bf11 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:15.202288 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-de73de8e-2988-4396-8bdc-7f6e7a37a826 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:16.189949 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:17.842426 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:18.400690 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:22.900006 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:56:24.777871 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:42.744994 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a3d48a4e-30ef-4773-a2b6-161a4572dc0f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:45.200586 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-c1a4e7f9-d322-405e-b003-4f9f8e636b78 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:46.173654 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:47.836352 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:48.388909 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:54.779586 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:56:59.899013 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:57:12.682287 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-f3c151f2-f644-4827-a205-afa8a6a225cc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:15.196674 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-a82fea4c-704c-44dd-8320-28283ac0bc97 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:16.188751 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:17.853959 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:18.385342 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:24.794552 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:36.898736 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:57:42.685681 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-53012cf6-7df0-4bcc-94dd-c88e1b134474 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:45.194536 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03a9c341-db20-4949-81c6-209d85ff0bde None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:46.200087 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:47.845634 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:48.407885 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:57:54.817040 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:12.691218 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-75a6c548-3248-4f93-ac5f-39f6f744b33b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:13.897057 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:58:15.199445 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-e3eb2925-0198-4c94-83ee-128a9ffc7059 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:16.184787 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:17.853773 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:18.373660 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:24.816715 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:42.745163 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-2dbcba2f-99c6-4542-ad69-624b5fa8b32f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:45.195932 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-cd8ed225-8df4-4dd2-8f68-056280a97cba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:46.222158 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-7b03a5ba-4680-4ecc-a52f-3c0350e6065a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:47.847952 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-03b55671-ed5a-446c-a2ee-e365900aa9c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:48.413173 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-8fb7c183-9700-4224-be8e-e36e80daa626 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 08 04:58:50.895719 dv-cinder-783643-4-iscsi neutron-server[101667]: DEBUG neutron.db.agents_db [None req-ad06d5c9-1bf1-4504-b03a-c33f85c41227 None None] Agent healthcheck: found 6 active agents {{(pid=101667) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 08 04:58:54.839215 dv-cinder-783643-4-iscsi neutron-server[101666]: DEBUG neutron_lib.callbacks.manager [None req-969840e0-0420-412f-a9f7-113fd859da81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8785436166431', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1924199'] for agent, after_update {{(pid=101666) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}}